Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 806.90787ms trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 20:00:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 806.985884ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.225704397s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:59:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.225725307s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.366117433s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:59:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.366147127s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.502097309s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:58:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.502119681s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.156982799s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:57:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.157009458s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 821.855981ms trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:56:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 821.900132ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 966.40335ms trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:56:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 966.426742ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 903.071842ms trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:55:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 903.093131ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.041710041s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:55:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.041732255s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.372932059s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:55:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.372959359s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.340961772s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:54:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.340985169s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 508.40727ms trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:54:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 508.429789ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 3.250416359s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:53:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 3.250441148s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.40062647s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:53:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1.400642702s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.025584064s trace: https://jaeger.dev.storj.io/trace/78791d41d75e16a0 FAIL (2026-03-06 19:53:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== 19:52:18.382132233 (8h52m15.978903242s) [upload=9902]: Uploading segments... Mar 6 19:52:18.382227489 (8h52m15.978998515s) [upload=9902]: Got next segment. Inline: false Mar 6 19:52:18.382313252 (8h52m15.979084279s) [upload=9902]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 6 19:52:18.382319269 (8h52m15.979090296s) [upload=9902]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 6 19:52:18.411471452 (8h52m16.008242482s) [seg_pos={0 0}, upload=9902]: Begin upload segment... Mar 6 19:52:18.411537096 (8h52m16.008308109s) [seg_pos={0 0}, upload=9902]: Done begin upload segment. Mar 6 19:52:18.411564540 (8h52m16.008335586s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.411626862 (8h52m16.008397897s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412356605 (8h52m16.009127631s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.412900389 (8h52m16.009671415s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413467061 (8h52m16.010238103s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.413653431 (8h52m16.010424457s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.414227965 (8h52m16.010998999s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415177146 (8h52m16.01194818s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415227889 (8h52m16.011998912s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415728547 (8h52m16.012499581s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.415910147 (8h52m16.012681174s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.416592462 (8h52m16.01336349s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417118897 (8h52m16.01388993s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417185844 (8h52m16.013956873s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.417686790 (8h52m16.014457823s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.418236951 (8h52m16.015007982s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.419293640 (8h52m16.016064672s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.420005502 (8h52m16.016776534s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Uploading piece... Mar 6 19:52:18.483654433 (8h52m16.080425441s) [upload=9902]: Next returned nil segment Mar 6 19:52:18.483671157 (8h52m16.08044219s) [upload=9902]: Waiting for error group managing segments... Mar 6 19:52:18.488078321 (8h52m16.084849398s) [noise=true , address=77.90.31.13:4655 , piece_id=47Q27QI7O2IYW7YQKFMJGGMWPVZWWKQTFVYPUMPUI7ORE7236XIQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.498435619 (8h52m16.095206647s) [noise=true , address=145.79.227.17:4994 , piece_id=TO3EOAILO4PHF6Z7WQA4RWZNNL3JO6EXXEF2RLW7IHAGWUU2TF4Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.502979814 (8h52m16.099750841s) [noise=true , address=77.90.31.16:4763 , piece_id=5Q7H3CU3MWSFPQGC67XMLCMTSUIEJQUV7QTO4UZLZY4MIVM76Z6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.506259140 (8h52m16.103030166s) [noise=true , address=77.90.31.14:4693 , piece_id=S7NAS2ZBHAQPZRHBRGRSZPLE6COQEEN6SZVMB7X2X6IMXTN5HCBQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.514529389 (8h52m16.111300413s) [noise=true , address=145.79.227.39:4022 , piece_id=U5GX3GLVWGWLU2BDWTHM7ST3MLLJDEAERWU3UEHO7Z2RXHGZU2DA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.785925494 (8h52m16.382696517s) [noise=true , address=167.17.72.70:4771 , piece_id=TDLPTUHPNXCICPPXRTRL7WCJSXPX22ONIWWPHNXFUNIKRYPYW52Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:18.810774903 (8h52m16.407545926s) [noise=true , address=77.90.31.18:4831 , piece_id=4PMIUNE4YXKLIJPML3VSUN4PF32TSLPOOSDZZNAXFWH7WICBOW3Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.002746550 (8h52m16.5995176s) [noise=true , address=193.149.164.71:4304 , piece_id=DTCL54GM76GWKAE7A3X5PUNFYO7H5JIKRT5WBEHYEDF2YNFYTOAA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.007614901 (8h52m16.604385924s) [noise=true , address=193.149.164.67:4018 , piece_id=GTQQP355TZZF4W7PPBYZS6ZQ6WYK7I3QIE4DZC7STWAKSBAMT4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.010443151 (8h52m16.607214176s) [noise=true , address=193.149.164.69:4101 , piece_id=BTIBVPSORFJQR3CLA5UV62NXNI6GD3JF4D5Z74KU4R4CXB3WHHKA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.012614014 (8h52m16.609385038s) [noise=true , address=193.149.164.70:4129 , piece_id=V7WMI7RDYDOAEQYWF2OTZL5LRPUA2S3V5WZN4BKDY6BI4YV3GRPQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:19.042145380 (8h52m16.638916406s) [noise=true , address=64.49.13.139:4479 , piece_id=XUYHOCSBATYECYHWLVZ4VBCMT3H4O5ETSQ5HZOB42OR3OY4LWJ6Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:52:21.314990180 (8h52m18.911761213s) [noise=true , address=167.17.72.71:4810 , piece_id=ANLHBMENEXSGTHBHLOIHMLM6JGHKIU2X6FPQQIUIVMVUOABNK73Q, seg_pos={0 0}, upload=9902]: Done uploading piece. err: <nil> Mar 6 19:53:18.344002671 (8h53m15.9407737s) [noise=true , address=45.91.116.10:4096 , piece_id=EIKWFKPE5BYSZGV5T4RPQED55PG2FXU3ZKSNRVCBD363YQDHS4BQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12MZX1GwZGrEi2q44dPiYrwMoum5A2caZtXTS3qiLNcoyHhon7p, address:45.91.116.10:4096): protocol: write tcp 159.223.143.39:44996->45.91.116.10:4096: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344173472 (8h53m15.940944497s) [noise=true , address=45.91.116.7:4037 , piece_id=YXDMXUBE7CEWLJZP6FPDCRVIDGG5CJ3Y3IKEKO7EE2DQUSG6W5RA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1iNPwE2XSfXcaXAXcrH2jcyNGYeDiiWvzAcDQffrmjPwTVqVmK, address:45.91.116.7:4037): protocol: write tcp 159.223.143.39:52854->45.91.116.7:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344535130 (8h53m15.941306156s) [noise=true , address=45.91.116.14:4199 , piece_id=EKGDG7LYV3O5NSDL3UPWFKXINYNAOSPYYOWQPTFN326AJ2ZXAXHQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:1d4B1KMLs2annUuJ3v81FJapS9Yg4omBTj48eWoi6HJxnSEjrf, address:45.91.116.14:4199): protocol: write tcp 159.223.143.39:57596->45.91.116.14:4199: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.344687364 (8h53m15.941458387s) [noise=true , address=45.91.116.11:4133 , piece_id=RZWV5JMLOJ36AH7KSDXVTL7CMHI4INEW6YOOQVMCIIC2NGS3XYJA, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:12e1wX7hiER8sX4MLm5qLue4mayiN4SxXFdZSxfymRaRZxRGU6E, address:45.91.116.11:4133): protocol: write tcp 159.223.143.39:56440->45.91.116.11:4133: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 6 19:53:18.345220236 (8h53m15.941991259s) [noise=true , address=45.91.116.8:4066 , piece_id=5MZHIJ3ELVBAJ7ABRKG565TLU4A4NKB7X6WAACY2JBSLACL5LGVQ, seg_pos={0 0}, upload=9902]: Done uploading piece. err: ecclient: upload failed (node:123uv49k8LraXJfYQg6KRQthrYs1Egc4c3eZWm5JPvDatFbykm8, address:45.91.116.8:4066): protocol: write tcp 159.223.143.39:44136->45.91.116.8:4066: use of closed network connection; context deadline exceeded Mar 6 19:53:18.345277850 (8h53m15.942048865s) [seg_pos={0 0}, upload=9902]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Mar 6 19:53:18.367560006 (8h53m15.964331035s) [upload=9902]: Done uploading segments... Mar 6 19:53:18.367606646 (8h53m15.964377681s) [upload=9902]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration: 1m0.025608704s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.655373659s trace: https://jaeger.dev.storj.io/trace/2dbb58a9d8a1ff8c FAIL (2026-03-06 18:16:27 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.655399981s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.5717557s trace: https://jaeger.dev.storj.io/trace/2dbb58a9d8a1ff8c FAIL (2026-03-06 18:15:26 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.571790756s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 706.93846ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6ad969dfb9acd7eb FAIL (2026-03-06 18:15:21 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.146.6:443: i/o timeout Duration: 706.963241ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 708.154312ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6ad969dfb9acd7eb FAIL (2026-03-06 18:14:58 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.146.6:443: i/o timeout Duration: 708.169711ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.715051151s trace: https://jaeger.dev.storj.io/trace/2dbb58a9d8a1ff8c FAIL (2026-03-06 18:14:56 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.71507368s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 827.291874ms trace: https://jaeger.dev.storj.io/trace/1b55394ff898363e FAIL (2026-03-06 18:14:29 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 827.314392ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X..X........................................................] duration: 2.693335652s trace: https://jaeger.dev.storj.io/trace/2dbb58a9d8a1ff8c FAIL (2026-03-06 18:14:02 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.693438363s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.163170616s trace: https://jaeger.dev.storj.io/trace/320ff841a18d7164 FAIL (2026-03-06 18:14:02 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.163197838s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 896.865703ms trace: https://jaeger.dev.storj.io/trace/1b55394ff898363e FAIL (2026-03-06 18:14:00 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 896.93262ms core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 725.273994ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6ad969dfb9acd7eb FAIL (2026-03-06 18:14:00 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.146.6:443: i/o timeout Duration: 725.31662ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [X.X.........................................................] duration: 959.122736ms trace: https://jaeger.dev.storj.io/trace/1b55394ff898363e FAIL (2026-03-06 18:13:31 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 959.146294ms core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 2.072594602s trace: https://jaeger.dev.storj.io/trace/320ff841a18d7164 FAIL (2026-03-06 18:13:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.072612622s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.175972204s trace: https://jaeger.dev.storj.io/trace/6a3de65856562c99 FAIL (2026-03-06 18:13:19 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.17599284s core uplink ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 703.291113ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6ad969dfb9acd7eb FAIL (2026-03-06 18:13:07 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.146.6:443: i/o timeout Duration: 703.314559ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X.X........................................................] duration: 846.194932ms trace: https://jaeger.dev.storj.io/trace/1b55394ff898363e FAIL (2026-03-06 18:13:00 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 846.228529ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X..X.......................................................] duration: 2.592984441s trace: https://jaeger.dev.storj.io/trace/2dbb58a9d8a1ff8c FAIL (2026-03-06 18:12:56 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.593010869s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 4.220848972s trace: https://jaeger.dev.storj.io/trace/6a3de65856562c99 FAIL (2026-03-06 18:12:51 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.220875166s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X..X......................................................] duration: 2.485224334s trace: https://jaeger.dev.storj.io/trace/2dbb58a9d8a1ff8c FAIL (2026-03-06 18:12:33 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.485253657s core uplink eu1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 719.257366ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6ad969dfb9acd7eb FAIL (2026-03-06 18:12:33 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.146.6:443: i/o timeout Duration: 719.274941ms core satellite ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 4.257163865s trace: https://jaeger.dev.storj.io/trace/6a3de65856562c99 FAIL (2026-03-06 18:12:20 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.25719178s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 2.114012901s trace: https://jaeger.dev.storj.io/trace/320ff841a18d7164 FAIL (2026-03-06 18:12:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.114036881s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X.X.......................................................] duration: 841.179859ms trace: https://jaeger.dev.storj.io/trace/1b55394ff898363e FAIL (2026-03-06 18:12:11 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 841.204216ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X..X.....................................................] duration: 2.702231969s trace: https://jaeger.dev.storj.io/trace/2dbb58a9d8a1ff8c FAIL (2026-03-06 18:12:04 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.702261851s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X.X......................................................] duration: 848.067653ms trace: https://jaeger.dev.storj.io/trace/1b55394ff898363e FAIL (2026-03-06 18:11:54 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 848.09294ms core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 4.386266767s trace: https://jaeger.dev.storj.io/trace/6a3de65856562c99 FAIL (2026-03-06 18:11:41 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.386301884s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 2.150097257s trace: https://jaeger.dev.storj.io/trace/320ff841a18d7164 FAIL (2026-03-06 18:11:34 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.1501201s core uplink ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 719.037372ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6ad969dfb9acd7eb FAIL (2026-03-06 18:11:31 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.146.6:443: i/o timeout Duration: 719.060782ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 705.99155ms target: https://ap1.storj.io/login trace: https://jaeger.dev.storj.io/trace/6ad969dfb9acd7eb FAIL (2026-03-06 18:11:13 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.146.6:443: i/o timeout Duration: 706.018569ms core satellite ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X..X....................................................] duration: 2.582099698s trace: https://jaeger.dev.storj.io/trace/2dbb58a9d8a1ff8c FAIL (2026-03-06 18:10:54 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.582127995s core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 2.134530574s trace: https://jaeger.dev.storj.io/trace/320ff841a18d7164 FAIL (2026-03-06 18:10:53 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.134556709s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X.X.....................................................] duration: 828.339984ms trace: https://jaeger.dev.storj.io/trace/1b55394ff898363e FAIL (2026-03-06 18:10:43 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 828.356871ms core uplink eu1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 4.337040667s trace: https://jaeger.dev.storj.io/trace/6a3de65856562c99 FAIL (2026-03-06 18:10:28 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.337092917s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 2.12377016s trace: https://jaeger.dev.storj.io/trace/320ff841a18d7164 FAIL (2026-03-06 18:10:28 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.123796286s core uplink ap1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X..X...................................................] duration: 2.759793167s trace: https://jaeger.dev.storj.io/trace/2dbb58a9d8a1ff8c FAIL (2026-03-06 18:10:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.759825197s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X.X....................................................] duration: 834.186638ms trace: https://jaeger.dev.storj.io/trace/1b55394ff898363e FAIL (2026-03-06 18:10:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 834.214269ms core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)