Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 27.995982282s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:31:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 27.996019283s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 1.974253713s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:29:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.974330522s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................................XX................] duration: 1.931809299s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:29:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.93183874s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 45.154439448s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:29:03 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 45.154472378s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 3.770679065s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:27:07 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 3.770705796s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 1.940274351s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:26:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.940466454s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 2.124849954s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:26:00 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.124894397s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 4.050914217s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:25:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 4.050954166s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 7.158565968s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:25:02 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 7.158593653s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 4.279946048s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:23:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 4.279971737s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 2.538539776s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:23:09 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.538579115s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 2.109211974s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:22:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.10924077s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 2.025308142s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:21:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.025353004s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration: 2.105801286s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:20:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.105852781s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 2.092244345s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:20:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.092278756s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 1.997905008s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:19:39 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.997941945s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 47.191460908s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:19:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 47.191520695s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 5.614718718s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:18:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 5.614742158s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.003640531s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:18:21 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1m0.003678127s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.003599813s trace: https://jaeger.dev.storj.io/trace/5caf0568af040bcb FAIL (2026-05-25 05:17:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== 33638s) [noise=true , address=212.102.52.217:4428 , piece_id=QSN42APFAWAZB7BUBINZQC2ER6V6LQU2X65KHXI47KHLCSZDKF2Q, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.563228363 (586h27m50.73534679s) [noise=true , address=212.102.52.217:4422 , piece_id=JQ3KEZF73BPCFHCCKXCRR4TVFIFVW6UU2QXHTVMGLSH4DKV5MCZQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.563724590 (586h27m50.735843017s) [noise=true , address=212.102.52.215:4370 , piece_id=45MW2IEZAT7E7PL5PLU724SHLIX4Q625W7BU54GE6MQRY5HK55EA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.564232749 (586h27m50.736351177s) [noise=true , address=212.102.52.216:4407 , piece_id=4PWFXILJPDNNK32DRRJJQRHCEL2GEJDDA24FRIE66SKXZH4LCQQA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.564716424 (586h27m50.736834852s) [noise=true , address=212.102.52.216:4416 , piece_id=MIXH43BIZNDF46ZPFDX5QPYYXXKHVLXNSV7G572RR6JVRNGPJ75A, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.565232061 (586h27m50.737350495s) [noise=true , address=212.102.52.214:4361 , piece_id=TB2UKLXCGJPKFQQJBENAYGTVJDBHXC473EBA243TVGMKHMRWGODQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.565714628 (586h27m50.737833054s) [noise=true , address=212.102.52.215:4392 , piece_id=PRX5S7AAEA7D7UEUXUC5HI7N3AT5RNWEHH5Z4C4NXCMFPX7KT5ZQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.566511046 (586h27m50.738629478s) [noise=true , address=212.102.52.215:4391 , piece_id=RAFPWHV4KZ3HEEWMDYDEPX6LLEBRVBGJQJFFBUCNJUR2XAJORBCA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.567845224 (586h27m50.739963651s) [noise=true , address=212.102.52.213:4334 , piece_id=PH25JHL5RTYIBYAGOJWFMMBVX3O4N27JCS4GNYHS4RZRZHGNX5HA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.568589706 (586h27m50.740708133s) [noise=true , address=212.102.52.214:4354 , piece_id=5Z4BFZIH23NPDXDMCA2OLI6SWT67Y2W4QH7KSDFODOTQVX2X5VDQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.570336204 (586h27m50.742454635s) [noise=true , address=212.102.52.214:4367 , piece_id=QQDHR7DICEAV5V5I4IAO3GBVHQOH35S3V7QSJKASY3B2HIZ43MCA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.570446797 (586h27m50.742565465s) [noise=true , address=212.102.52.213:4336 , piece_id=UY4UI34W57UUL6K4JCHP4GO4MGFSMWVLTG5EB7TNL3LSEMRUY6YQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.571592514 (586h27m50.743710942s) [noise=true , address=212.102.52.213:4333 , piece_id=OG5AFYTYQDHAMLYIPJ6NUU45W6BHLSUG5WQUWNZL6M2MWIPFM3OQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.572806088 (586h27m50.74492452s) [noise=true , address=212.102.52.213:4323 , piece_id=A54SPY2MY6ASNQNX7WEZKGZIAYI3YL2YQU4OHOZXAYAQ4VVETUXA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.574905354 (586h27m50.747023784s) [noise=true , address=212.102.52.215:4378 , piece_id=BX64WDFFAUQY5D46RJIRMLKRR44OYLO2V6V6I62K66QAJDQAPSIQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:39.081763997 (586h27m51.253882407s) [upload=656616]: Next returned nil segment May 25 05:16:39.081794618 (586h27m51.253913039s) [upload=656616]: Waiting for error group managing segments... May 25 05:16:39.205390932 (586h27m51.377509363s) [noise=true , address=212.102.52.217:4428 , piece_id=QSN42APFAWAZB7BUBINZQC2ER6V6LQU2X65KHXI47KHLCSZDKF2Q, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.206416733 (586h27m51.378535141s) [noise=true , address=212.102.52.214:4348 , piece_id=PMEO3L6H6L2Y5KJHKOJEVY5QLEL4NHXQMB55XMLWUSYIIAQIHIQA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.207196126 (586h27m51.379314556s) [noise=true , address=212.102.52.215:4378 , piece_id=BX64WDFFAUQY5D46RJIRMLKRR44OYLO2V6V6I62K66QAJDQAPSIQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.207338755 (586h27m51.379457175s) [noise=true , address=212.102.52.214:4361 , piece_id=TB2UKLXCGJPKFQQJBENAYGTVJDBHXC473EBA243TVGMKHMRWGODQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.208388279 (586h27m51.380506717s) [noise=true , address=212.102.52.215:4391 , piece_id=RAFPWHV4KZ3HEEWMDYDEPX6LLEBRVBGJQJFFBUCNJUR2XAJORBCA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.208694469 (586h27m51.380812891s) [noise=true , address=212.102.52.216:4416 , piece_id=MIXH43BIZNDF46ZPFDX5QPYYXXKHVLXNSV7G572RR6JVRNGPJ75A, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.209269875 (586h27m51.381388299s) [noise=true , address=212.102.52.213:4334 , piece_id=PH25JHL5RTYIBYAGOJWFMMBVX3O4N27JCS4GNYHS4RZRZHGNX5HA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.209351211 (586h27m51.381469639s) [noise=true , address=212.102.52.214:4354 , piece_id=5Z4BFZIH23NPDXDMCA2OLI6SWT67Y2W4QH7KSDFODOTQVX2X5VDQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.212558606 (586h27m51.384677025s) [noise=true , address=212.102.52.217:4435 , piece_id=VIHZQ2C2FAWRSX6JDFA5TILZLRK44F6OYHYS6TFYVM7446VBH7LQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.212715444 (586h27m51.384833873s) [noise=true , address=212.102.52.217:4437 , piece_id=QE7YSKZAADGWA6JZUVOYHRJUFBMC6UMUCFEWBDL5PR2WK4G4222Q, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.213250648 (586h27m51.385369083s) [noise=true , address=212.102.52.213:4336 , piece_id=UY4UI34W57UUL6K4JCHP4GO4MGFSMWVLTG5EB7TNL3LSEMRUY6YQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.213845456 (586h27m51.385963883s) [noise=true , address=212.102.52.217:4422 , piece_id=JQ3KEZF73BPCFHCCKXCRR4TVFIFVW6UU2QXHTVMGLSH4DKV5MCZQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.214542199 (586h27m51.386660619s) [noise=true , address=212.102.52.215:4392 , piece_id=PRX5S7AAEA7D7UEUXUC5HI7N3AT5RNWEHH5Z4C4NXCMFPX7KT5ZQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.214563523 (586h27m51.386681933s) [noise=true , address=212.102.52.216:4408 , piece_id=SCQMQEWNR3X6ALLXDZFWETUMZL6DOBJ4RWIAQXXLQMXP66PWQGAA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.214690808 (586h27m51.386809235s) [noise=true , address=212.102.52.215:4370 , piece_id=45MW2IEZAT7E7PL5PLU724SHLIX4Q625W7BU54GE6MQRY5HK55EA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.217223260 (586h27m51.389341691s) [noise=true , address=212.102.52.216:4393 , piece_id=ODOO2C3O5CX5OEOWFXLL4I5N7R44Q7IOVTUAJIOHQKWQHFBWXFKQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.217247719 (586h27m51.389366149s) [seg_pos={0 0}, upload=656616]: Satisfied cohort requirements after 16 pieces May 25 05:16:39.217765749 (586h27m51.389884177s) [noise=true , address=212.102.52.216:4407 , piece_id=4PWFXILJPDNNK32DRRJJQRHCEL2GEJDDA24FRIE66SKXZH4LCQQA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GVGZ5AsUeSjou5J2AGU7913SpaVzd317SRL5dYKTkfE4w489N): protocol: expected piece hash; context canceled; EOF May 25 05:16:39.217781217 (586h27m51.389899643s) [noise=true , address=212.102.52.216:4407 , piece_id=4PWFXILJPDNNK32DRRJJQRHCEL2GEJDDA24FRIE66SKXZH4LCQQA, seg_pos={0 0}, upload=656616]: Long tail cancellation due to optimal threshold May 25 05:16:39.217802270 (586h27m51.389920676s) [noise=true , address=212.102.52.213:4323 , piece_id=A54SPY2MY6ASNQNX7WEZKGZIAYI3YL2YQU4OHOZXAYAQ4VVETUXA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nvo4dwVwbPtVveYYjpPEpZBSgnt1Q4tWSdckbRqZyZdxUA4s3): protocol: expected piece hash; context canceled; EOF May 25 05:16:39.217811753 (586h27m51.389930177s) [noise=true , address=212.102.52.213:4323 , piece_id=A54SPY2MY6ASNQNX7WEZKGZIAYI3YL2YQU4OHOZXAYAQ4VVETUXA, seg_pos={0 0}, upload=656616]: Long tail cancellation due to optimal threshold May 25 05:16:39.218006078 (586h27m51.390124503s) [noise=true , address=212.102.52.213:4333 , piece_id=OG5AFYTYQDHAMLYIPJ6NUU45W6BHLSUG5WQUWNZL6M2MWIPFM3OQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Gm3eZxZPxPeHqLQ32kpXMpCgnwRoP8epBYtiFF1EH3U9LEazY): protocol: expected piece hash; context canceled; EOF May 25 05:16:39.218013696 (586h27m51.390132115s) [noise=true , address=212.102.52.213:4333 , piece_id=OG5AFYTYQDHAMLYIPJ6NUU45W6BHLSUG5WQUWNZL6M2MWIPFM3OQ, seg_pos={0 0}, upload=656616]: Long tail cancellation due to optimal threshold May 25 05:16:39.218171939 (586h27m51.390290368s) [noise=true , address=212.102.52.214:4367 , piece_id=QQDHR7DICEAV5V5I4IAO3GBVHQOH35S3V7QSJKASY3B2HIZ43MCA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 25 05:16:39.218179497 (586h27m51.390297926s) [noise=true , address=212.102.52.214:4367 , piece_id=QQDHR7DICEAV5V5I4IAO3GBVHQOH35S3V7QSJKASY3B2HIZ43MCA, seg_pos={0 0}, upload=656616]: Long tail cancellation due to optimal threshold May 25 05:16:39.218205505 (586h27m51.390323925s) [seg_pos={0 0}, upload=656616]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 05:16:39.218474079 (586h27m51.390592498s) [upload=656616]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:16:39.218481859 (586h27m51.390600279s) [upload=656616]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:17:19.994901619 (586h28m32.167020059s) [upload=656616]: Done uploading segments... May 25 05:17:19.994949901 (586h28m32.167068322s) [upload=656616]: Upload finished. err: <nil> Duration: 1m0.003635316s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.577480612s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:29:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.577500748s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.693465209s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:28:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.693493428s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.592894022s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:27:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.592928639s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.652131298s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:26:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.652168198s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.640228519s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:25:41 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.640278222s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.656707957s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:24:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.656741617s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.645764591s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:23:38 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.645797855s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.679639321s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:23:05 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.679719727s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.604575656s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:22:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.604602863s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.671595655s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:21:19 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.671631995s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.690601247s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:20:51 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.690636336s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.641992922s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:20:31 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.642037371s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.582324482s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:19:33 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.582364401s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.771804105s trace: https://jaeger.dev.storj.io/trace/76fbe3048ca860be FAIL (2026-05-25 03:19:09 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.771834202s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 1.89039609s trace: https://jaeger.dev.storj.io/trace/76fbe3048ca860be FAIL (2026-05-25 03:18:50 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.890433054s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.497664008s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:18:31 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.497693362s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.622735856s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:18:07 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.622842037s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.648648748s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:17:46 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.648681171s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.692524038s trace: https://jaeger.dev.storj.io/trace/76fbe3048ca860be FAIL (2026-05-25 03:17:41 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.692556033s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.638510997s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:17:17 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.638575362s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.550247315s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:16:58 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.550346236s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.703308925s trace: https://jaeger.dev.storj.io/trace/76fbe3048ca860be FAIL (2026-05-25 03:16:39 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.703335427s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.598253861s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:15:48 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.598303762s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.575603189s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:15:28 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.575634575s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.846136882s trace: https://jaeger.dev.storj.io/trace/76fbe3048ca860be FAIL (2026-05-25 03:15:25 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.846165363s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 1.657968691s trace: https://jaeger.dev.storj.io/trace/76fbe3048ca860be FAIL (2026-05-25 03:15:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.658037649s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.850948228s trace: https://jaeger.dev.storj.io/trace/76fbe3048ca860be FAIL (2026-05-25 03:14:36 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.851047746s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.582664399s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:14:36 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.582690181s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.861245992s trace: https://jaeger.dev.storj.io/trace/76fbe3048ca860be FAIL (2026-05-25 03:14:18 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.861275792s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.851577902s trace: https://jaeger.dev.storj.io/trace/76fbe3048ca860be FAIL (2026-05-25 03:13:32 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.851599165s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)