Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 320364 reports (Page 396 of 6408)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [..................X.......X.............X....X..........X...]
duration: 
1.357604468s
trace: 
https://jaeger.dev.storj.io/trace/21780b32410ce66
FAIL (2026-03-10 19:09:27 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
116529]: Got next segment. Inline: false
Mar 10 19:06:47.907812827 (104h6m45.504583852s) [upload=116529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:06:47.907821925 (104h6m45.504592955s) [upload=116529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:06:47.940557630 (104h6m45.537328665s) [seg_pos={0 0}, upload=116529]: Begin upload segment...
Mar 10 19:06:47.940626826 (104h6m45.537397872s) [seg_pos={0 0}, upload=116529]: Done begin upload segment.
Mar 10 19:06:47.940664974 (104h6m45.537436009s) [noise=true , address=45.91.116.14:4222    , piece_id=DN3SNW3LKHWHUL6B3PAS5P7OG44ZDWKQXKKOPU53LJDSKXKNBREQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.940762459 (104h6m45.537533493s) [noise=true , address=64.49.13.154:4928    , piece_id=VQSF7TC2IYV4S52MG3ID7PBEMPHL27JARON4XDJWJK4TOX2DJ6RA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.941373070 (104h6m45.538144102s) [noise=true , address=79.127.205.237:4234  , piece_id=7HTPOWTGA2GFYYSNDOOB5PNE44GPJKYVCZCEVFOUL24GJMJJC6EA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.941854421 (104h6m45.538625449s) [noise=true , address=64.49.13.138:4487    , piece_id=FOCEUSC64R5Q7ZOCWE5XKAZXSQDXLDUEQ6TACPWYY2PXRUR4LJZA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.942384626 (104h6m45.539155657s) [noise=true , address=45.91.116.6:4978     , piece_id=TCYHWUUEZNKGOGJ3OSHOJU7I5SXSO7NODMUFAF5HN67GYS66RRWA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.943308667 (104h6m45.5400797s) [noise=true , address=145.79.227.21:4483   , piece_id=7MSS7NE4SUWLFOU7KSAGCZ3IZVIJNSE56KHGRL3GCGQVJ3DKP4VQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.943609163 (104h6m45.540380198s) [noise=true , address=167.17.72.71:4811    , piece_id=YK6OJXQTR5AIHI5CYQYRRAU4UXGC4LHHEOK56UG4OKDKT3TI2UVA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.944346996 (104h6m45.54111803s) [noise=true , address=77.90.31.18:4812     , piece_id=GQUHTOY4SM5B2GRHCAFZEG5W5HKRXM3R42EHBDZVFPZC2DWG3WUA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.944371169 (104h6m45.541142202s) [noise=true , address=45.91.116.8:4068     , piece_id=Q6ERVQ3EO4ET54DDXKWHZWENPRY7FDEINMK5RVFT2YSFFPN3WVEQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.945840127 (104h6m45.54261116s) [noise=true , address=77.90.31.19:4848     , piece_id=M4SDGI2RIF2TAUL3YQAP5AQ345ZKHQYV4CGPXC4KKM55FU6TNSPQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.946047960 (104h6m45.542818985s) [noise=true , address=45.91.116.5:4308     , piece_id=Y4K77UYELRJEJAXBMBYBJ3SUJ7BNEOQ4NUCPLXWY24OBMVJIJWTA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.947317100 (104h6m45.544088132s) [noise=true , address=45.91.116.13:4170    , piece_id=R56YVTNBMRBVVY4J4JMTLQSJJ46DVY4CRQM6RIA2YNGA3CKPR7UQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.947712870 (104h6m45.544483904s) [noise=true , address=77.90.31.15:4713     , piece_id=7FAXWQKYDTYUAAZGKIVFZC4534BJDJ4SEJFBJO335WCRSDRUHZAQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.948608160 (104h6m45.545379198s) [noise=true , address=77.90.31.17:4786     , piece_id=FJJFNH5LLXEJ3AU3O2WLI5F7TU6LESJZQY72Q7O27QLRK5KOVLNQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.948926354 (104h6m45.545697388s) [noise=true , address=77.90.31.10:4535     , piece_id=AQ3Z632XLGXGOTGTZUIVK53Q5NXGFMWCVYYLOHTJWURBAP6HQK4Q, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.949957787 (104h6m45.546728825s) [noise=true , address=79.127.219.45:4881   , piece_id=K6IU7ZLP5S7YK6SPIRSQH4EDSPDS57MB3T5FPMVIL6BEH257LM7Q, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.951273293 (104h6m45.548044327s) [noise=true , address=79.127.205.234:4181  , piece_id=UD6B44BMN7H2WK3P2TIIAUFKZB2K6PH3EEIFBAVFED2Q53TQDDZQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.951829900 (104h6m45.548600934s) [noise=true , address=79.127.219.41:4937   , piece_id=TB2LRED4R7QC7R2QMD5ZGRC6236JKDGO7KZLDKCC4K7M676YPQMQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:48.036482492 (104h6m45.633253551s) [upload=116529]: Next returned nil segment
Mar 10 19:06:48.036501010 (104h6m45.633272043s) [upload=116529]: Waiting for error group managing segments...
Mar 10 19:06:48.042266571 (104h6m45.639037584s) [noise=true , address=45.91.116.14:4222    , piece_id=DN3SNW3LKHWHUL6B3PAS5P7OG44ZDWKQXKKOPU53LJDSKXKNBREQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.043683514 (104h6m45.640454543s) [noise=true , address=145.79.227.21:4483   , piece_id=7MSS7NE4SUWLFOU7KSAGCZ3IZVIJNSE56KHGRL3GCGQVJ3DKP4VQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.044327860 (104h6m45.641098874s) [noise=true , address=79.127.219.45:4881   , piece_id=K6IU7ZLP5S7YK6SPIRSQH4EDSPDS57MB3T5FPMVIL6BEH257LM7Q, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.046521721 (104h6m45.643292745s) [noise=true , address=79.127.219.41:4937   , piece_id=TB2LRED4R7QC7R2QMD5ZGRC6236JKDGO7KZLDKCC4K7M676YPQMQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.049264342 (104h6m45.646035356s) [noise=true , address=45.91.116.13:4170    , piece_id=R56YVTNBMRBVVY4J4JMTLQSJJ46DVY4CRQM6RIA2YNGA3CKPR7UQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.051826600 (104h6m45.648597629s) [noise=true , address=45.91.116.8:4068     , piece_id=Q6ERVQ3EO4ET54DDXKWHZWENPRY7FDEINMK5RVFT2YSFFPN3WVEQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.053239446 (104h6m45.65001047s) [noise=true , address=45.91.116.5:4308     , piece_id=Y4K77UYELRJEJAXBMBYBJ3SUJ7BNEOQ4NUCPLXWY24OBMVJIJWTA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.057554590 (104h6m45.654325622s) [noise=true , address=45.91.116.6:4978     , piece_id=TCYHWUUEZNKGOGJ3OSHOJU7I5SXSO7NODMUFAF5HN67GYS66RRWA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.347909714 (104h6m45.944680732s) [noise=true , address=167.17.72.71:4811    , piece_id=YK6OJXQTR5AIHI5CYQYRRAU4UXGC4LHHEOK56UG4OKDKT3TI2UVA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.497098288 (104h6m46.093869316s) [noise=true , address=79.127.205.234:4181  , piece_id=UD6B44BMN7H2WK3P2TIIAUFKZB2K6PH3EEIFBAVFED2Q53TQDDZQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.524549543 (104h6m46.121320561s) [noise=true , address=64.49.13.154:4928    , piece_id=VQSF7TC2IYV4S52MG3ID7PBEMPHL27JARON4XDJWJK4TOX2DJ6RA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.567475047 (104h6m46.164246061s) [noise=true , address=64.49.13.138:4487    , piece_id=FOCEUSC64R5Q7ZOCWE5XKAZXSQDXLDUEQ6TACPWYY2PXRUR4LJZA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:49.393957509 (104h6m46.990728537s) [noise=true , address=79.127.205.237:4234  , piece_id=7HTPOWTGA2GFYYSNDOOB5PNE44GPJKYVCZCEVFOUL24GJMJJC6EA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:07:47.865864834 (104h7m45.462635862s) [noise=true , address=77.90.31.19:4848     , piece_id=M4SDGI2RIF2TAUL3YQAP5AQ345ZKHQYV4CGPXC4KKM55FU6TNSPQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD, address:77.90.31.19:4848): protocol: write tcp 159.223.143.39:35766->77.90.31.19:4848: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866066060 (104h7m45.462837092s) [noise=true , address=77.90.31.15:4713     , piece_id=7FAXWQKYDTYUAAZGKIVFZC4534BJDJ4SEJFBJO335WCRSDRUHZAQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:1Liv9RcEgfjxodPuadijzkcUGgJEy7LfKqHGFhaJCKbcxKkNN8, address:77.90.31.15:4713): protocol: rpc: dial tcp 77.90.31.15:4713: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866185581 (104h7m45.462956607s) [noise=true , address=77.90.31.18:4812     , piece_id=GQUHTOY4SM5B2GRHCAFZEG5W5HKRXM3R42EHBDZVFPZC2DWG3WUA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: write tcp 159.223.143.39:44376->77.90.31.18:4812: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866263516 (104h7m45.463034544s) [noise=true , address=77.90.31.10:4535     , piece_id=AQ3Z632XLGXGOTGTZUIVK53Q5NXGFMWCVYYLOHTJWURBAP6HQK4Q, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz, address:77.90.31.10:4535): protocol: write tcp 159.223.143.39:48368->77.90.31.10:4535: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866517656 (104h7m45.463288691s) [noise=true , address=77.90.31.17:4786     , piece_id=FJJFNH5LLXEJ3AU3O2WLI5F7TU6LESJZQY72Q7O27QLRK5KOVLNQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:128QrekLqpXLAJs7yqNziNLmt2i13SuMx1ZhMPdUpDosw71dgQh, address:77.90.31.17:4786): protocol: write tcp 159.223.143.39:40520->77.90.31.17:4786: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866574294 (104h7m45.463345325s) [seg_pos={0 0}, upload=116529]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:07:47.888227569 (104h7m45.484998602s) [upload=116529]: Done uploading segments...
Mar 10 19:07:47.888332065 (104h7m45.485103168s) [upload=116529]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.357629999s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [.X..........................................................]
duration: 
532.152179ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:09:23 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 532.178319ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.........................X...X...X...................X......]
duration: 
1.905725807s
trace: 
https://jaeger.dev.storj.io/trace/6eaf7e5e6a726518
FAIL (2026-03-10 19:09:22 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 10 19:03:23.988246988 (104h3m21.585018018s) [upload=116469]: Starting upload
Mar 10 19:03:23.988312885 (104h3m21.585083919s) [upload=116469]: Done starting upload
Mar 10 19:03:23.988365267 (104h3m21.585136284s) [upload=116469]: Uploading segments...
Mar 10 19:03:23.988867979 (104h3m21.585639014s) [upload=116469]: Got next segment. Inline: false
Mar 10 19:03:23.988945739 (104h3m21.585716772s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:03:23.988952971 (104h3m21.585724005s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:03:24.019774719 (104h3m21.616545751s) [seg_pos={0 0}, upload=116469]: Begin upload segment...
Mar 10 19:03:24.019937835 (104h3m21.616708869s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.019981650 (104h3m21.616752677s) [seg_pos={0 0}, upload=116469]: Done begin upload segment.
Mar 10 19:03:24.020015989 (104h3m21.616787022s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.021928583 (104h3m21.618699617s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022484849 (104h3m21.619255883s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022762950 (104h3m21.619533983s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023221204 (104h3m21.619992237s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023336927 (104h3m21.620107969s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023765391 (104h3m21.620536423s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024157847 (104h3m21.620928871s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024176290 (104h3m21.620947323s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024230206 (104h3m21.621001229s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027199763 (104h3m21.623970797s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027808072 (104h3m21.624579102s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.028305994 (104h3m21.625077023s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029003543 (104h3m21.625774576s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029538948 (104h3m21.626309973s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.030274650 (104h3m21.627045683s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.032013478 (104h3m21.628784505s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.095600253 (104h3m21.692371268s) [upload=116469]: Next returned nil segment
Mar 10 19:03:24.095613852 (104h3m21.692384876s) [upload=116469]: Waiting for error group managing segments...
Mar 10 19:03:24.098625718 (104h3m21.695396745s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.099652296 (104h3m21.69642332s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.110953983 (104h3m21.707724996s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.118406692 (104h3m21.715177705s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.120589152 (104h3m21.717360176s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.122357574 (104h3m21.719128587s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.129335989 (104h3m21.726107017s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.391666873 (104h3m21.988437897s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.402782831 (104h3m21.999553857s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.590224293 (104h3m22.18699531s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.609965381 (104h3m22.206736393s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.617983306 (104h3m22.214754335s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.618344030 (104h3m22.215115053s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:04:23.953044817 (104h4m21.549815854s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953336512 (104h4m21.550107545s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: rpc: dial tcp 77.90.31.18:4812: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953405756 (104h4m21.550176788s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW, address:77.90.31.11:4574): protocol: rpc: dial tcp 77.90.31.11:4574: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953728735 (104h4m21.550499767s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953818559 (104h4m21.550589577s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c, address:77.90.31.19:4858): protocol: write tcp 159.223.143.39:44754->77.90.31.19:4858: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953865997 (104h4m21.550637012s) [seg_pos={0 0}, upload=116469]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:04:23.975449925 (104h4m21.572220956s) [upload=116469]: Done uploading segments...
Mar 10 19:04:23.975517148 (104h4m21.572288184s) [upload=116469]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.905757345s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [......X..................X..................................]
duration: 
691.202046ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:09:14 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 691.254298ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
3 out of 60 is failed (threshold=3) [.X................................................X......X..]
duration: 
4.974839563s
trace: 
https://jaeger.dev.storj.io/trace/60e038fc0a6bf5b6
FAIL (2026-03-10 19:09:12 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pload=116536]: Uploading piece...
Mar 10 19:07:08.052812464 (104h7m5.649583488s) [noise=true , address=89.149.201.147:4012  , piece_id=6FCDV7M3V6OYZNCRXFKU7AZFQOIOUDCTRXZFZRVKY5D653CVVSRQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.053192041 (104h7m5.649963064s) [noise=true , address=185.167.204.206:4053 , piece_id=FL3WYO7QV7WVPNTC5L2HQIZLZ5Y5KXCCCHTFZ4WLMHLYY2DG3RXQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.053534479 (104h7m5.650305505s) [noise=true , address=81.171.14.70:4030    , piece_id=CSNUZOIPMFMJWTOFAWBPXSSET7ITOX4XHSVP5OPQQAQOTFCHOJ4A, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.053903216 (104h7m5.650674239s) [noise=true , address=185.167.204.206:4065 , piece_id=73HCX24X7GU4EXZHRDM7BV6UNKA5FNYVCNHWXIQXW7OV4VETWDNA, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.054577271 (104h7m5.651348304s) [noise=true , address=185.167.204.206:4049 , piece_id=NI52TPUMI4JVQ5TVMNQKN6IW3YZSU4EBXCLECA4PP7YSPVSNMTZQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.054916818 (104h7m5.651687833s) [noise=true , address=81.171.14.70:4039    , piece_id=B5KA4MB6AQTBQIGJBRHR2BVUOMRH5ISISW6GRTCCQ7KVDYGXWOYA, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055013708 (104h7m5.651784734s) [noise=true , address=185.167.204.206:4047 , piece_id=2LYHINYE53WQOF34OLI2KA4HUNEBU2SADVHQFMZBVZB4MPSAV6RQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055398681 (104h7m5.652169696s) [noise=true , address=89.149.201.147:4014  , piece_id=2CDEUE6S3DFXJ57KQIAO7ZUTBXBZLL7ORFR2SJ5PLGGC7WSXCS5Q, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055413527 (104h7m5.652184552s) [noise=true , address=81.171.14.70:4031    , piece_id=22JBHNL7OQRH4TOBPKYIFH5ZVIIL2LIJDFQGGLXBW6UGTDBC4EBQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055769117 (104h7m5.652540146s) [noise=true , address=81.171.14.70:4026    , piece_id=CVYTYXF7RPZS4FMUPFUMINXJBXY42NOI3QHI5A5YSU26FTSGA72Q, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055793969 (104h7m5.652564986s) [noise=true , address=89.149.201.147:4013  , piece_id=T2VCAXBO5MJW5THHW7AOSSZJ3FJUV3WCVMMHSAONG7VXY6OCSZ2Q, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.059615569 (104h7m5.656386589s) [noise=true , address=89.149.201.147:4007  , piece_id=ICSU7CLO5VDMAJSX47CCMF3ZCHPGEZT6TWV3PTD25WCWB4MCO7JQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.483435998 (104h7m6.080207019s) [upload=116536]: Next returned nil segment
Mar 10 19:07:08.483463545 (104h7m6.080234571s) [upload=116536]: Waiting for error group managing segments...
Mar 10 19:07:08.670085108 (104h7m6.266856132s) [noise=true , address=81.171.14.70:4030    , piece_id=CSNUZOIPMFMJWTOFAWBPXSSET7ITOX4XHSVP5OPQQAQOTFCHOJ4A, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.671751688 (104h7m6.26852271s) [noise=true , address=81.171.14.70:4039    , piece_id=B5KA4MB6AQTBQIGJBRHR2BVUOMRH5ISISW6GRTCCQ7KVDYGXWOYA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.675713790 (104h7m6.272484814s) [noise=true , address=81.171.14.70:4026    , piece_id=CVYTYXF7RPZS4FMUPFUMINXJBXY42NOI3QHI5A5YSU26FTSGA72Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.678729994 (104h7m6.275501017s) [noise=true , address=81.171.14.70:4031    , piece_id=22JBHNL7OQRH4TOBPKYIFH5ZVIIL2LIJDFQGGLXBW6UGTDBC4EBQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.679660985 (104h7m6.276432008s) [noise=true , address=185.167.204.206:4056 , piece_id=QNKSFJNUWFOKEEO4TBMWZQSMCABV3SES7XMQOBLIRB3Y4IEDNUZQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.704364612 (104h7m6.301135641s) [noise=true , address=89.149.201.147:4013  , piece_id=T2VCAXBO5MJW5THHW7AOSSZJ3FJUV3WCVMMHSAONG7VXY6OCSZ2Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.713873267 (104h7m6.310644294s) [noise=true , address=81.171.14.70:4036    , piece_id=EER6RSAHNMHEVN4XAX32OY3FUI4OK24I5LUFLPYHWDS34SNGPQRQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.716489526 (104h7m6.313260548s) [noise=true , address=185.167.204.205:4013 , piece_id=DLV3JPA46SEE2MLT2OUCYTTGRKE3YIFQ7J53SKCTKMZYDFRLQOVQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.720880819 (104h7m6.317651844s) [noise=true , address=185.167.204.206:4065 , piece_id=73HCX24X7GU4EXZHRDM7BV6UNKA5FNYVCNHWXIQXW7OV4VETWDNA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.721091989 (104h7m6.317863022s) [noise=true , address=81.171.14.70:4027    , piece_id=XUI3PS252PXEW6RU2KMS6JKB3VRWFAP4AH4MV2VHFNA2EY6BIG5A, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.722224062 (104h7m6.318995085s) [noise=true , address=89.149.201.147:4019  , piece_id=55XGKBTVO53PNYUPYO4AYAA7RQXNVCKHSB7VJ5FT474JJEOPIMCQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.726774177 (104h7m6.323545218s) [noise=true , address=89.149.201.147:4006  , piece_id=4275N735EX3ESSBGQMG6UURDYKZQT4KDTGI3UTZFPLZNUKMRBXEQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.740457541 (104h7m6.337228557s) [noise=true , address=185.167.204.206:4053 , piece_id=FL3WYO7QV7WVPNTC5L2HQIZLZ5Y5KXCCCHTFZ4WLMHLYY2DG3RXQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.764058724 (104h7m6.360829747s) [noise=true , address=185.167.204.206:4049 , piece_id=NI52TPUMI4JVQ5TVMNQKN6IW3YZSU4EBXCLECA4PP7YSPVSNMTZQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.764920220 (104h7m6.361691243s) [noise=true , address=185.167.204.206:4047 , piece_id=2LYHINYE53WQOF34OLI2KA4HUNEBU2SADVHQFMZBVZB4MPSAV6RQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.777059183 (104h7m6.373830232s) [noise=true , address=185.167.204.205:4005 , piece_id=WG55KC6CHZZTDQGQX4CKLT5IQN3PZS5HST6ADPV3K7IURYYMOPFQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.872009693 (104h7m6.468780719s) [noise=true , address=89.149.201.147:4012  , piece_id=6FCDV7M3V6OYZNCRXFKU7AZFQOIOUDCTRXZFZRVKY5D653CVVSRQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.184413047 (104h7m6.781184061s) [noise=true , address=81.171.14.70:4025    , piece_id=Q4ZIYTW5CSVBRXLFZFBUUZHBC4ER63OE7CNPZP5UBLNS2AFFT7HQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.218611147 (104h7m6.81538216s) [noise=true , address=81.171.14.70:4028    , piece_id=W2MHTUKXME6LLSBOCLUJWQAGEZM34ITWB2QVSO3NQWUFYIUSEY3Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.231788290 (104h7m6.828559319s) [noise=true , address=89.149.201.147:4024  , piece_id=SM35AGGVT24VDC46LEL5SR6XE3Y4WVEWFQJSFZS2K2XRMF64IWQA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.243351966 (104h7m6.840122993s) [noise=true , address=185.167.204.206:4045 , piece_id=KNNFTU6BBNDSTJPWTEKJIIYZQLRYL3T7SBSTFUUYI6EGPL2LFFBA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.911871668 (104h7m7.508642693s) [noise=true , address=185.167.204.205:4012 , piece_id=4G3LH5G6IGVEI3APRDKIYMEI7BT5H7MQYHXOVCLWAZZD433BV5YQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.957977058 (104h7m7.554748082s) [noise=true , address=185.167.204.206:4039 , piece_id=KC66HUYTZO4HBTMTPZF7OBPGEO2NVOHN6MXA256LQAOYM36AOSNQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:10.427584748 (104h7m8.024355769s) [noise=true , address=185.167.204.205:4001 , piece_id=WFICPLSRPVAWA2PTJGUP32TMVADLZ4M3E2YAOF64FJQFJBT2ATCQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:22.545770375 (104h7m20.142541405s) [noise=true , address=185.167.204.205:4019 , piece_id=7I4GCV5ACILSRHAUTT2DUPWORYIZAAMLGXQEDDSQWXWO66I3N7ZA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:08:07.676830562 (104h8m5.273601595s) [noise=true , address=89.149.201.147:4007  , piece_id=ICSU7CLO5VDMAJSX47CCMF3ZCHPGEZT6TWV3PTD25WCWB4MCO7JQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:38552->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:08:07.676856227 (104h8m5.273627257s) [noise=true , address=89.149.201.147:4021  , piece_id=2IYNAWS3HJWU7Z53DQ77BPWUXWA2W26Q5PTKUMLNXUGNWRK7NDLQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:35864->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:08:07.677137384 (104h8m5.273908417s) [noise=true , address=89.149.201.147:4014  , piece_id=2CDEUE6S3DFXJ57KQIAO7ZUTBXBZLL7ORFR2SJ5PLGGC7WSXCS5Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:48614->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:08:07.677172053 (104h8m5.273943066s) [seg_pos={0 0}, upload=116536]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 19:08:07.777852887 (104h8m5.3746239s) [upload=116536]: Done uploading segments...
Mar 10 19:08:07.777889836 (104h8m5.37466086s) [upload=116536]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 4.974866836s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [..X.........................................................]
duration: 
540.567487ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:08:55 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 540.592626ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [...................X.......X.............X....X..........X..]
duration: 
1.52438876s
trace: 
https://jaeger.dev.storj.io/trace/21780b32410ce66
FAIL (2026-03-10 19:08:50 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
116529]: Got next segment. Inline: false
Mar 10 19:06:47.907812827 (104h6m45.504583852s) [upload=116529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:06:47.907821925 (104h6m45.504592955s) [upload=116529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:06:47.940557630 (104h6m45.537328665s) [seg_pos={0 0}, upload=116529]: Begin upload segment...
Mar 10 19:06:47.940626826 (104h6m45.537397872s) [seg_pos={0 0}, upload=116529]: Done begin upload segment.
Mar 10 19:06:47.940664974 (104h6m45.537436009s) [noise=true , address=45.91.116.14:4222    , piece_id=DN3SNW3LKHWHUL6B3PAS5P7OG44ZDWKQXKKOPU53LJDSKXKNBREQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.940762459 (104h6m45.537533493s) [noise=true , address=64.49.13.154:4928    , piece_id=VQSF7TC2IYV4S52MG3ID7PBEMPHL27JARON4XDJWJK4TOX2DJ6RA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.941373070 (104h6m45.538144102s) [noise=true , address=79.127.205.237:4234  , piece_id=7HTPOWTGA2GFYYSNDOOB5PNE44GPJKYVCZCEVFOUL24GJMJJC6EA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.941854421 (104h6m45.538625449s) [noise=true , address=64.49.13.138:4487    , piece_id=FOCEUSC64R5Q7ZOCWE5XKAZXSQDXLDUEQ6TACPWYY2PXRUR4LJZA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.942384626 (104h6m45.539155657s) [noise=true , address=45.91.116.6:4978     , piece_id=TCYHWUUEZNKGOGJ3OSHOJU7I5SXSO7NODMUFAF5HN67GYS66RRWA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.943308667 (104h6m45.5400797s) [noise=true , address=145.79.227.21:4483   , piece_id=7MSS7NE4SUWLFOU7KSAGCZ3IZVIJNSE56KHGRL3GCGQVJ3DKP4VQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.943609163 (104h6m45.540380198s) [noise=true , address=167.17.72.71:4811    , piece_id=YK6OJXQTR5AIHI5CYQYRRAU4UXGC4LHHEOK56UG4OKDKT3TI2UVA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.944346996 (104h6m45.54111803s) [noise=true , address=77.90.31.18:4812     , piece_id=GQUHTOY4SM5B2GRHCAFZEG5W5HKRXM3R42EHBDZVFPZC2DWG3WUA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.944371169 (104h6m45.541142202s) [noise=true , address=45.91.116.8:4068     , piece_id=Q6ERVQ3EO4ET54DDXKWHZWENPRY7FDEINMK5RVFT2YSFFPN3WVEQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.945840127 (104h6m45.54261116s) [noise=true , address=77.90.31.19:4848     , piece_id=M4SDGI2RIF2TAUL3YQAP5AQ345ZKHQYV4CGPXC4KKM55FU6TNSPQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.946047960 (104h6m45.542818985s) [noise=true , address=45.91.116.5:4308     , piece_id=Y4K77UYELRJEJAXBMBYBJ3SUJ7BNEOQ4NUCPLXWY24OBMVJIJWTA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.947317100 (104h6m45.544088132s) [noise=true , address=45.91.116.13:4170    , piece_id=R56YVTNBMRBVVY4J4JMTLQSJJ46DVY4CRQM6RIA2YNGA3CKPR7UQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.947712870 (104h6m45.544483904s) [noise=true , address=77.90.31.15:4713     , piece_id=7FAXWQKYDTYUAAZGKIVFZC4534BJDJ4SEJFBJO335WCRSDRUHZAQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.948608160 (104h6m45.545379198s) [noise=true , address=77.90.31.17:4786     , piece_id=FJJFNH5LLXEJ3AU3O2WLI5F7TU6LESJZQY72Q7O27QLRK5KOVLNQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.948926354 (104h6m45.545697388s) [noise=true , address=77.90.31.10:4535     , piece_id=AQ3Z632XLGXGOTGTZUIVK53Q5NXGFMWCVYYLOHTJWURBAP6HQK4Q, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.949957787 (104h6m45.546728825s) [noise=true , address=79.127.219.45:4881   , piece_id=K6IU7ZLP5S7YK6SPIRSQH4EDSPDS57MB3T5FPMVIL6BEH257LM7Q, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.951273293 (104h6m45.548044327s) [noise=true , address=79.127.205.234:4181  , piece_id=UD6B44BMN7H2WK3P2TIIAUFKZB2K6PH3EEIFBAVFED2Q53TQDDZQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.951829900 (104h6m45.548600934s) [noise=true , address=79.127.219.41:4937   , piece_id=TB2LRED4R7QC7R2QMD5ZGRC6236JKDGO7KZLDKCC4K7M676YPQMQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:48.036482492 (104h6m45.633253551s) [upload=116529]: Next returned nil segment
Mar 10 19:06:48.036501010 (104h6m45.633272043s) [upload=116529]: Waiting for error group managing segments...
Mar 10 19:06:48.042266571 (104h6m45.639037584s) [noise=true , address=45.91.116.14:4222    , piece_id=DN3SNW3LKHWHUL6B3PAS5P7OG44ZDWKQXKKOPU53LJDSKXKNBREQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.043683514 (104h6m45.640454543s) [noise=true , address=145.79.227.21:4483   , piece_id=7MSS7NE4SUWLFOU7KSAGCZ3IZVIJNSE56KHGRL3GCGQVJ3DKP4VQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.044327860 (104h6m45.641098874s) [noise=true , address=79.127.219.45:4881   , piece_id=K6IU7ZLP5S7YK6SPIRSQH4EDSPDS57MB3T5FPMVIL6BEH257LM7Q, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.046521721 (104h6m45.643292745s) [noise=true , address=79.127.219.41:4937   , piece_id=TB2LRED4R7QC7R2QMD5ZGRC6236JKDGO7KZLDKCC4K7M676YPQMQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.049264342 (104h6m45.646035356s) [noise=true , address=45.91.116.13:4170    , piece_id=R56YVTNBMRBVVY4J4JMTLQSJJ46DVY4CRQM6RIA2YNGA3CKPR7UQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.051826600 (104h6m45.648597629s) [noise=true , address=45.91.116.8:4068     , piece_id=Q6ERVQ3EO4ET54DDXKWHZWENPRY7FDEINMK5RVFT2YSFFPN3WVEQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.053239446 (104h6m45.65001047s) [noise=true , address=45.91.116.5:4308     , piece_id=Y4K77UYELRJEJAXBMBYBJ3SUJ7BNEOQ4NUCPLXWY24OBMVJIJWTA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.057554590 (104h6m45.654325622s) [noise=true , address=45.91.116.6:4978     , piece_id=TCYHWUUEZNKGOGJ3OSHOJU7I5SXSO7NODMUFAF5HN67GYS66RRWA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.347909714 (104h6m45.944680732s) [noise=true , address=167.17.72.71:4811    , piece_id=YK6OJXQTR5AIHI5CYQYRRAU4UXGC4LHHEOK56UG4OKDKT3TI2UVA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.497098288 (104h6m46.093869316s) [noise=true , address=79.127.205.234:4181  , piece_id=UD6B44BMN7H2WK3P2TIIAUFKZB2K6PH3EEIFBAVFED2Q53TQDDZQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.524549543 (104h6m46.121320561s) [noise=true , address=64.49.13.154:4928    , piece_id=VQSF7TC2IYV4S52MG3ID7PBEMPHL27JARON4XDJWJK4TOX2DJ6RA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.567475047 (104h6m46.164246061s) [noise=true , address=64.49.13.138:4487    , piece_id=FOCEUSC64R5Q7ZOCWE5XKAZXSQDXLDUEQ6TACPWYY2PXRUR4LJZA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:49.393957509 (104h6m46.990728537s) [noise=true , address=79.127.205.237:4234  , piece_id=7HTPOWTGA2GFYYSNDOOB5PNE44GPJKYVCZCEVFOUL24GJMJJC6EA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:07:47.865864834 (104h7m45.462635862s) [noise=true , address=77.90.31.19:4848     , piece_id=M4SDGI2RIF2TAUL3YQAP5AQ345ZKHQYV4CGPXC4KKM55FU6TNSPQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD, address:77.90.31.19:4848): protocol: write tcp 159.223.143.39:35766->77.90.31.19:4848: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866066060 (104h7m45.462837092s) [noise=true , address=77.90.31.15:4713     , piece_id=7FAXWQKYDTYUAAZGKIVFZC4534BJDJ4SEJFBJO335WCRSDRUHZAQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:1Liv9RcEgfjxodPuadijzkcUGgJEy7LfKqHGFhaJCKbcxKkNN8, address:77.90.31.15:4713): protocol: rpc: dial tcp 77.90.31.15:4713: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866185581 (104h7m45.462956607s) [noise=true , address=77.90.31.18:4812     , piece_id=GQUHTOY4SM5B2GRHCAFZEG5W5HKRXM3R42EHBDZVFPZC2DWG3WUA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: write tcp 159.223.143.39:44376->77.90.31.18:4812: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866263516 (104h7m45.463034544s) [noise=true , address=77.90.31.10:4535     , piece_id=AQ3Z632XLGXGOTGTZUIVK53Q5NXGFMWCVYYLOHTJWURBAP6HQK4Q, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz, address:77.90.31.10:4535): protocol: write tcp 159.223.143.39:48368->77.90.31.10:4535: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866517656 (104h7m45.463288691s) [noise=true , address=77.90.31.17:4786     , piece_id=FJJFNH5LLXEJ3AU3O2WLI5F7TU6LESJZQY72Q7O27QLRK5KOVLNQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:128QrekLqpXLAJs7yqNziNLmt2i13SuMx1ZhMPdUpDosw71dgQh, address:77.90.31.17:4786): protocol: write tcp 159.223.143.39:40520->77.90.31.17:4786: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866574294 (104h7m45.463345325s) [seg_pos={0 0}, upload=116529]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:07:47.888227569 (104h7m45.484998602s) [upload=116529]: Done uploading segments...
Mar 10 19:07:47.888332065 (104h7m45.485103168s) [upload=116529]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.524480141s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [.......X..................X.................................]
duration: 
550.222536ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:08:48 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 550.256042ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [...X........................................................]
duration: 
469.067064ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:08:28 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 469.10109ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [..........................X...X...X...................X.....]
duration: 
1.262968171s
trace: 
https://jaeger.dev.storj.io/trace/6eaf7e5e6a726518
FAIL (2026-03-10 19:08:10 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 10 19:03:23.988246988 (104h3m21.585018018s) [upload=116469]: Starting upload
Mar 10 19:03:23.988312885 (104h3m21.585083919s) [upload=116469]: Done starting upload
Mar 10 19:03:23.988365267 (104h3m21.585136284s) [upload=116469]: Uploading segments...
Mar 10 19:03:23.988867979 (104h3m21.585639014s) [upload=116469]: Got next segment. Inline: false
Mar 10 19:03:23.988945739 (104h3m21.585716772s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:03:23.988952971 (104h3m21.585724005s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:03:24.019774719 (104h3m21.616545751s) [seg_pos={0 0}, upload=116469]: Begin upload segment...
Mar 10 19:03:24.019937835 (104h3m21.616708869s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.019981650 (104h3m21.616752677s) [seg_pos={0 0}, upload=116469]: Done begin upload segment.
Mar 10 19:03:24.020015989 (104h3m21.616787022s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.021928583 (104h3m21.618699617s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022484849 (104h3m21.619255883s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022762950 (104h3m21.619533983s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023221204 (104h3m21.619992237s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023336927 (104h3m21.620107969s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023765391 (104h3m21.620536423s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024157847 (104h3m21.620928871s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024176290 (104h3m21.620947323s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024230206 (104h3m21.621001229s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027199763 (104h3m21.623970797s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027808072 (104h3m21.624579102s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.028305994 (104h3m21.625077023s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029003543 (104h3m21.625774576s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029538948 (104h3m21.626309973s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.030274650 (104h3m21.627045683s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.032013478 (104h3m21.628784505s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.095600253 (104h3m21.692371268s) [upload=116469]: Next returned nil segment
Mar 10 19:03:24.095613852 (104h3m21.692384876s) [upload=116469]: Waiting for error group managing segments...
Mar 10 19:03:24.098625718 (104h3m21.695396745s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.099652296 (104h3m21.69642332s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.110953983 (104h3m21.707724996s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.118406692 (104h3m21.715177705s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.120589152 (104h3m21.717360176s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.122357574 (104h3m21.719128587s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.129335989 (104h3m21.726107017s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.391666873 (104h3m21.988437897s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.402782831 (104h3m21.999553857s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.590224293 (104h3m22.18699531s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.609965381 (104h3m22.206736393s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.617983306 (104h3m22.214754335s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.618344030 (104h3m22.215115053s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:04:23.953044817 (104h4m21.549815854s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953336512 (104h4m21.550107545s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: rpc: dial tcp 77.90.31.18:4812: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953405756 (104h4m21.550176788s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW, address:77.90.31.11:4574): protocol: rpc: dial tcp 77.90.31.11:4574: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953728735 (104h4m21.550499767s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953818559 (104h4m21.550589577s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c, address:77.90.31.19:4858): protocol: write tcp 159.223.143.39:44754->77.90.31.19:4858: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953865997 (104h4m21.550637012s) [seg_pos={0 0}, upload=116469]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:04:23.975449925 (104h4m21.572220956s) [upload=116469]: Done uploading segments...
Mar 10 19:04:23.975517148 (104h4m21.572288184s) [upload=116469]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.263003847s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
3 out of 60 is failed (threshold=3) [..X................................................X......X.]
duration: 
2.456541403s
trace: 
https://jaeger.dev.storj.io/trace/60e038fc0a6bf5b6
FAIL (2026-03-10 19:08:10 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pload=116536]: Uploading piece...
Mar 10 19:07:08.052812464 (104h7m5.649583488s) [noise=true , address=89.149.201.147:4012  , piece_id=6FCDV7M3V6OYZNCRXFKU7AZFQOIOUDCTRXZFZRVKY5D653CVVSRQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.053192041 (104h7m5.649963064s) [noise=true , address=185.167.204.206:4053 , piece_id=FL3WYO7QV7WVPNTC5L2HQIZLZ5Y5KXCCCHTFZ4WLMHLYY2DG3RXQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.053534479 (104h7m5.650305505s) [noise=true , address=81.171.14.70:4030    , piece_id=CSNUZOIPMFMJWTOFAWBPXSSET7ITOX4XHSVP5OPQQAQOTFCHOJ4A, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.053903216 (104h7m5.650674239s) [noise=true , address=185.167.204.206:4065 , piece_id=73HCX24X7GU4EXZHRDM7BV6UNKA5FNYVCNHWXIQXW7OV4VETWDNA, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.054577271 (104h7m5.651348304s) [noise=true , address=185.167.204.206:4049 , piece_id=NI52TPUMI4JVQ5TVMNQKN6IW3YZSU4EBXCLECA4PP7YSPVSNMTZQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.054916818 (104h7m5.651687833s) [noise=true , address=81.171.14.70:4039    , piece_id=B5KA4MB6AQTBQIGJBRHR2BVUOMRH5ISISW6GRTCCQ7KVDYGXWOYA, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055013708 (104h7m5.651784734s) [noise=true , address=185.167.204.206:4047 , piece_id=2LYHINYE53WQOF34OLI2KA4HUNEBU2SADVHQFMZBVZB4MPSAV6RQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055398681 (104h7m5.652169696s) [noise=true , address=89.149.201.147:4014  , piece_id=2CDEUE6S3DFXJ57KQIAO7ZUTBXBZLL7ORFR2SJ5PLGGC7WSXCS5Q, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055413527 (104h7m5.652184552s) [noise=true , address=81.171.14.70:4031    , piece_id=22JBHNL7OQRH4TOBPKYIFH5ZVIIL2LIJDFQGGLXBW6UGTDBC4EBQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055769117 (104h7m5.652540146s) [noise=true , address=81.171.14.70:4026    , piece_id=CVYTYXF7RPZS4FMUPFUMINXJBXY42NOI3QHI5A5YSU26FTSGA72Q, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055793969 (104h7m5.652564986s) [noise=true , address=89.149.201.147:4013  , piece_id=T2VCAXBO5MJW5THHW7AOSSZJ3FJUV3WCVMMHSAONG7VXY6OCSZ2Q, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.059615569 (104h7m5.656386589s) [noise=true , address=89.149.201.147:4007  , piece_id=ICSU7CLO5VDMAJSX47CCMF3ZCHPGEZT6TWV3PTD25WCWB4MCO7JQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.483435998 (104h7m6.080207019s) [upload=116536]: Next returned nil segment
Mar 10 19:07:08.483463545 (104h7m6.080234571s) [upload=116536]: Waiting for error group managing segments...
Mar 10 19:07:08.670085108 (104h7m6.266856132s) [noise=true , address=81.171.14.70:4030    , piece_id=CSNUZOIPMFMJWTOFAWBPXSSET7ITOX4XHSVP5OPQQAQOTFCHOJ4A, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.671751688 (104h7m6.26852271s) [noise=true , address=81.171.14.70:4039    , piece_id=B5KA4MB6AQTBQIGJBRHR2BVUOMRH5ISISW6GRTCCQ7KVDYGXWOYA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.675713790 (104h7m6.272484814s) [noise=true , address=81.171.14.70:4026    , piece_id=CVYTYXF7RPZS4FMUPFUMINXJBXY42NOI3QHI5A5YSU26FTSGA72Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.678729994 (104h7m6.275501017s) [noise=true , address=81.171.14.70:4031    , piece_id=22JBHNL7OQRH4TOBPKYIFH5ZVIIL2LIJDFQGGLXBW6UGTDBC4EBQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.679660985 (104h7m6.276432008s) [noise=true , address=185.167.204.206:4056 , piece_id=QNKSFJNUWFOKEEO4TBMWZQSMCABV3SES7XMQOBLIRB3Y4IEDNUZQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.704364612 (104h7m6.301135641s) [noise=true , address=89.149.201.147:4013  , piece_id=T2VCAXBO5MJW5THHW7AOSSZJ3FJUV3WCVMMHSAONG7VXY6OCSZ2Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.713873267 (104h7m6.310644294s) [noise=true , address=81.171.14.70:4036    , piece_id=EER6RSAHNMHEVN4XAX32OY3FUI4OK24I5LUFLPYHWDS34SNGPQRQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.716489526 (104h7m6.313260548s) [noise=true , address=185.167.204.205:4013 , piece_id=DLV3JPA46SEE2MLT2OUCYTTGRKE3YIFQ7J53SKCTKMZYDFRLQOVQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.720880819 (104h7m6.317651844s) [noise=true , address=185.167.204.206:4065 , piece_id=73HCX24X7GU4EXZHRDM7BV6UNKA5FNYVCNHWXIQXW7OV4VETWDNA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.721091989 (104h7m6.317863022s) [noise=true , address=81.171.14.70:4027    , piece_id=XUI3PS252PXEW6RU2KMS6JKB3VRWFAP4AH4MV2VHFNA2EY6BIG5A, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.722224062 (104h7m6.318995085s) [noise=true , address=89.149.201.147:4019  , piece_id=55XGKBTVO53PNYUPYO4AYAA7RQXNVCKHSB7VJ5FT474JJEOPIMCQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.726774177 (104h7m6.323545218s) [noise=true , address=89.149.201.147:4006  , piece_id=4275N735EX3ESSBGQMG6UURDYKZQT4KDTGI3UTZFPLZNUKMRBXEQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.740457541 (104h7m6.337228557s) [noise=true , address=185.167.204.206:4053 , piece_id=FL3WYO7QV7WVPNTC5L2HQIZLZ5Y5KXCCCHTFZ4WLMHLYY2DG3RXQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.764058724 (104h7m6.360829747s) [noise=true , address=185.167.204.206:4049 , piece_id=NI52TPUMI4JVQ5TVMNQKN6IW3YZSU4EBXCLECA4PP7YSPVSNMTZQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.764920220 (104h7m6.361691243s) [noise=true , address=185.167.204.206:4047 , piece_id=2LYHINYE53WQOF34OLI2KA4HUNEBU2SADVHQFMZBVZB4MPSAV6RQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.777059183 (104h7m6.373830232s) [noise=true , address=185.167.204.205:4005 , piece_id=WG55KC6CHZZTDQGQX4CKLT5IQN3PZS5HST6ADPV3K7IURYYMOPFQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.872009693 (104h7m6.468780719s) [noise=true , address=89.149.201.147:4012  , piece_id=6FCDV7M3V6OYZNCRXFKU7AZFQOIOUDCTRXZFZRVKY5D653CVVSRQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.184413047 (104h7m6.781184061s) [noise=true , address=81.171.14.70:4025    , piece_id=Q4ZIYTW5CSVBRXLFZFBUUZHBC4ER63OE7CNPZP5UBLNS2AFFT7HQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.218611147 (104h7m6.81538216s) [noise=true , address=81.171.14.70:4028    , piece_id=W2MHTUKXME6LLSBOCLUJWQAGEZM34ITWB2QVSO3NQWUFYIUSEY3Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.231788290 (104h7m6.828559319s) [noise=true , address=89.149.201.147:4024  , piece_id=SM35AGGVT24VDC46LEL5SR6XE3Y4WVEWFQJSFZS2K2XRMF64IWQA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.243351966 (104h7m6.840122993s) [noise=true , address=185.167.204.206:4045 , piece_id=KNNFTU6BBNDSTJPWTEKJIIYZQLRYL3T7SBSTFUUYI6EGPL2LFFBA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.911871668 (104h7m7.508642693s) [noise=true , address=185.167.204.205:4012 , piece_id=4G3LH5G6IGVEI3APRDKIYMEI7BT5H7MQYHXOVCLWAZZD433BV5YQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.957977058 (104h7m7.554748082s) [noise=true , address=185.167.204.206:4039 , piece_id=KC66HUYTZO4HBTMTPZF7OBPGEO2NVOHN6MXA256LQAOYM36AOSNQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:10.427584748 (104h7m8.024355769s) [noise=true , address=185.167.204.205:4001 , piece_id=WFICPLSRPVAWA2PTJGUP32TMVADLZ4M3E2YAOF64FJQFJBT2ATCQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:22.545770375 (104h7m20.142541405s) [noise=true , address=185.167.204.205:4019 , piece_id=7I4GCV5ACILSRHAUTT2DUPWORYIZAAMLGXQEDDSQWXWO66I3N7ZA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:08:07.676830562 (104h8m5.273601595s) [noise=true , address=89.149.201.147:4007  , piece_id=ICSU7CLO5VDMAJSX47CCMF3ZCHPGEZT6TWV3PTD25WCWB4MCO7JQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:38552->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:08:07.676856227 (104h8m5.273627257s) [noise=true , address=89.149.201.147:4021  , piece_id=2IYNAWS3HJWU7Z53DQ77BPWUXWA2W26Q5PTKUMLNXUGNWRK7NDLQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:35864->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:08:07.677137384 (104h8m5.273908417s) [noise=true , address=89.149.201.147:4014  , piece_id=2CDEUE6S3DFXJ57KQIAO7ZUTBXBZLL7ORFR2SJ5PLGGC7WSXCS5Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:48614->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:08:07.677172053 (104h8m5.273943066s) [seg_pos={0 0}, upload=116536]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 19:08:07.777852887 (104h8m5.3746239s) [upload=116536]: Done uploading segments...
Mar 10 19:08:07.777889836 (104h8m5.37466086s) [upload=116536]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.456564629s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
4 out of 60 is failed (threshold=3) [X..X................................................X......X]
duration: 
1m0.103819404s
trace: 
https://jaeger.dev.storj.io/trace/60e038fc0a6bf5b6
FAIL (2026-03-10 19:08:07 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
pload=116536]: Uploading piece...
Mar 10 19:07:08.052812464 (104h7m5.649583488s) [noise=true , address=89.149.201.147:4012  , piece_id=6FCDV7M3V6OYZNCRXFKU7AZFQOIOUDCTRXZFZRVKY5D653CVVSRQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.053192041 (104h7m5.649963064s) [noise=true , address=185.167.204.206:4053 , piece_id=FL3WYO7QV7WVPNTC5L2HQIZLZ5Y5KXCCCHTFZ4WLMHLYY2DG3RXQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.053534479 (104h7m5.650305505s) [noise=true , address=81.171.14.70:4030    , piece_id=CSNUZOIPMFMJWTOFAWBPXSSET7ITOX4XHSVP5OPQQAQOTFCHOJ4A, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.053903216 (104h7m5.650674239s) [noise=true , address=185.167.204.206:4065 , piece_id=73HCX24X7GU4EXZHRDM7BV6UNKA5FNYVCNHWXIQXW7OV4VETWDNA, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.054577271 (104h7m5.651348304s) [noise=true , address=185.167.204.206:4049 , piece_id=NI52TPUMI4JVQ5TVMNQKN6IW3YZSU4EBXCLECA4PP7YSPVSNMTZQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.054916818 (104h7m5.651687833s) [noise=true , address=81.171.14.70:4039    , piece_id=B5KA4MB6AQTBQIGJBRHR2BVUOMRH5ISISW6GRTCCQ7KVDYGXWOYA, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055013708 (104h7m5.651784734s) [noise=true , address=185.167.204.206:4047 , piece_id=2LYHINYE53WQOF34OLI2KA4HUNEBU2SADVHQFMZBVZB4MPSAV6RQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055398681 (104h7m5.652169696s) [noise=true , address=89.149.201.147:4014  , piece_id=2CDEUE6S3DFXJ57KQIAO7ZUTBXBZLL7ORFR2SJ5PLGGC7WSXCS5Q, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055413527 (104h7m5.652184552s) [noise=true , address=81.171.14.70:4031    , piece_id=22JBHNL7OQRH4TOBPKYIFH5ZVIIL2LIJDFQGGLXBW6UGTDBC4EBQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055769117 (104h7m5.652540146s) [noise=true , address=81.171.14.70:4026    , piece_id=CVYTYXF7RPZS4FMUPFUMINXJBXY42NOI3QHI5A5YSU26FTSGA72Q, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.055793969 (104h7m5.652564986s) [noise=true , address=89.149.201.147:4013  , piece_id=T2VCAXBO5MJW5THHW7AOSSZJ3FJUV3WCVMMHSAONG7VXY6OCSZ2Q, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.059615569 (104h7m5.656386589s) [noise=true , address=89.149.201.147:4007  , piece_id=ICSU7CLO5VDMAJSX47CCMF3ZCHPGEZT6TWV3PTD25WCWB4MCO7JQ, seg_pos={0 0}, upload=116536]: Uploading piece...
Mar 10 19:07:08.483435998 (104h7m6.080207019s) [upload=116536]: Next returned nil segment
Mar 10 19:07:08.483463545 (104h7m6.080234571s) [upload=116536]: Waiting for error group managing segments...
Mar 10 19:07:08.670085108 (104h7m6.266856132s) [noise=true , address=81.171.14.70:4030    , piece_id=CSNUZOIPMFMJWTOFAWBPXSSET7ITOX4XHSVP5OPQQAQOTFCHOJ4A, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.671751688 (104h7m6.26852271s) [noise=true , address=81.171.14.70:4039    , piece_id=B5KA4MB6AQTBQIGJBRHR2BVUOMRH5ISISW6GRTCCQ7KVDYGXWOYA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.675713790 (104h7m6.272484814s) [noise=true , address=81.171.14.70:4026    , piece_id=CVYTYXF7RPZS4FMUPFUMINXJBXY42NOI3QHI5A5YSU26FTSGA72Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.678729994 (104h7m6.275501017s) [noise=true , address=81.171.14.70:4031    , piece_id=22JBHNL7OQRH4TOBPKYIFH5ZVIIL2LIJDFQGGLXBW6UGTDBC4EBQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.679660985 (104h7m6.276432008s) [noise=true , address=185.167.204.206:4056 , piece_id=QNKSFJNUWFOKEEO4TBMWZQSMCABV3SES7XMQOBLIRB3Y4IEDNUZQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.704364612 (104h7m6.301135641s) [noise=true , address=89.149.201.147:4013  , piece_id=T2VCAXBO5MJW5THHW7AOSSZJ3FJUV3WCVMMHSAONG7VXY6OCSZ2Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.713873267 (104h7m6.310644294s) [noise=true , address=81.171.14.70:4036    , piece_id=EER6RSAHNMHEVN4XAX32OY3FUI4OK24I5LUFLPYHWDS34SNGPQRQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.716489526 (104h7m6.313260548s) [noise=true , address=185.167.204.205:4013 , piece_id=DLV3JPA46SEE2MLT2OUCYTTGRKE3YIFQ7J53SKCTKMZYDFRLQOVQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.720880819 (104h7m6.317651844s) [noise=true , address=185.167.204.206:4065 , piece_id=73HCX24X7GU4EXZHRDM7BV6UNKA5FNYVCNHWXIQXW7OV4VETWDNA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.721091989 (104h7m6.317863022s) [noise=true , address=81.171.14.70:4027    , piece_id=XUI3PS252PXEW6RU2KMS6JKB3VRWFAP4AH4MV2VHFNA2EY6BIG5A, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.722224062 (104h7m6.318995085s) [noise=true , address=89.149.201.147:4019  , piece_id=55XGKBTVO53PNYUPYO4AYAA7RQXNVCKHSB7VJ5FT474JJEOPIMCQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.726774177 (104h7m6.323545218s) [noise=true , address=89.149.201.147:4006  , piece_id=4275N735EX3ESSBGQMG6UURDYKZQT4KDTGI3UTZFPLZNUKMRBXEQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.740457541 (104h7m6.337228557s) [noise=true , address=185.167.204.206:4053 , piece_id=FL3WYO7QV7WVPNTC5L2HQIZLZ5Y5KXCCCHTFZ4WLMHLYY2DG3RXQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.764058724 (104h7m6.360829747s) [noise=true , address=185.167.204.206:4049 , piece_id=NI52TPUMI4JVQ5TVMNQKN6IW3YZSU4EBXCLECA4PP7YSPVSNMTZQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.764920220 (104h7m6.361691243s) [noise=true , address=185.167.204.206:4047 , piece_id=2LYHINYE53WQOF34OLI2KA4HUNEBU2SADVHQFMZBVZB4MPSAV6RQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.777059183 (104h7m6.373830232s) [noise=true , address=185.167.204.205:4005 , piece_id=WG55KC6CHZZTDQGQX4CKLT5IQN3PZS5HST6ADPV3K7IURYYMOPFQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:08.872009693 (104h7m6.468780719s) [noise=true , address=89.149.201.147:4012  , piece_id=6FCDV7M3V6OYZNCRXFKU7AZFQOIOUDCTRXZFZRVKY5D653CVVSRQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.184413047 (104h7m6.781184061s) [noise=true , address=81.171.14.70:4025    , piece_id=Q4ZIYTW5CSVBRXLFZFBUUZHBC4ER63OE7CNPZP5UBLNS2AFFT7HQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.218611147 (104h7m6.81538216s) [noise=true , address=81.171.14.70:4028    , piece_id=W2MHTUKXME6LLSBOCLUJWQAGEZM34ITWB2QVSO3NQWUFYIUSEY3Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.231788290 (104h7m6.828559319s) [noise=true , address=89.149.201.147:4024  , piece_id=SM35AGGVT24VDC46LEL5SR6XE3Y4WVEWFQJSFZS2K2XRMF64IWQA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.243351966 (104h7m6.840122993s) [noise=true , address=185.167.204.206:4045 , piece_id=KNNFTU6BBNDSTJPWTEKJIIYZQLRYL3T7SBSTFUUYI6EGPL2LFFBA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.911871668 (104h7m7.508642693s) [noise=true , address=185.167.204.205:4012 , piece_id=4G3LH5G6IGVEI3APRDKIYMEI7BT5H7MQYHXOVCLWAZZD433BV5YQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:09.957977058 (104h7m7.554748082s) [noise=true , address=185.167.204.206:4039 , piece_id=KC66HUYTZO4HBTMTPZF7OBPGEO2NVOHN6MXA256LQAOYM36AOSNQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:10.427584748 (104h7m8.024355769s) [noise=true , address=185.167.204.205:4001 , piece_id=WFICPLSRPVAWA2PTJGUP32TMVADLZ4M3E2YAOF64FJQFJBT2ATCQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:07:22.545770375 (104h7m20.142541405s) [noise=true , address=185.167.204.205:4019 , piece_id=7I4GCV5ACILSRHAUTT2DUPWORYIZAAMLGXQEDDSQWXWO66I3N7ZA, seg_pos={0 0}, upload=116536]: Done uploading piece. err: <nil>
Mar 10 19:08:07.676830562 (104h8m5.273601595s) [noise=true , address=89.149.201.147:4007  , piece_id=ICSU7CLO5VDMAJSX47CCMF3ZCHPGEZT6TWV3PTD25WCWB4MCO7JQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:38552->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:08:07.676856227 (104h8m5.273627257s) [noise=true , address=89.149.201.147:4021  , piece_id=2IYNAWS3HJWU7Z53DQ77BPWUXWA2W26Q5PTKUMLNXUGNWRK7NDLQ, seg_pos={0 0}, upload=116536]: Done uploading piece. err: ecclient: upload failed (node:121wRVh3zqETdzR1KQbRUBmnd11SsxFkFHngWG8uxyndwsbUXJz, address:89.149.201.147:4021): protocol: read tcp 159.223.143.39:35864->89.149.201.147:4021: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:08:07.677137384 (104h8m5.273908417s) [noise=true , address=89.149.201.147:4014  , piece_id=2CDEUE6S3DFXJ57KQIAO7ZUTBXBZLL7ORFR2SJ5PLGGC7WSXCS5Q, seg_pos={0 0}, upload=116536]: Done uploading piece. err: ecclient: upload failed (node:1wgtphHKaTejC1qrJ98sDysBwtj2Zeqw2c5UFk1HMqfY8Buvr, address:89.149.201.147:4014): protocol: read tcp 159.223.143.39:48614->89.149.201.147:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:08:07.677172053 (104h8m5.273943066s) [seg_pos={0 0}, upload=116536]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 19:08:07.777852887 (104h8m5.3746239s) [upload=116536]: Done uploading segments...
Mar 10 19:08:07.777889836 (104h8m5.37466086s) [upload=116536]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 1m0.103844499s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [........X..................X................................]
duration: 
591.719312ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:08:03 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 592.002958ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [....................X.......X.............X....X..........X.]
duration: 
6.782724061s
trace: 
https://jaeger.dev.storj.io/trace/21780b32410ce66
FAIL (2026-03-10 19:07:54 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
116529]: Got next segment. Inline: false
Mar 10 19:06:47.907812827 (104h6m45.504583852s) [upload=116529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:06:47.907821925 (104h6m45.504592955s) [upload=116529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:06:47.940557630 (104h6m45.537328665s) [seg_pos={0 0}, upload=116529]: Begin upload segment...
Mar 10 19:06:47.940626826 (104h6m45.537397872s) [seg_pos={0 0}, upload=116529]: Done begin upload segment.
Mar 10 19:06:47.940664974 (104h6m45.537436009s) [noise=true , address=45.91.116.14:4222    , piece_id=DN3SNW3LKHWHUL6B3PAS5P7OG44ZDWKQXKKOPU53LJDSKXKNBREQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.940762459 (104h6m45.537533493s) [noise=true , address=64.49.13.154:4928    , piece_id=VQSF7TC2IYV4S52MG3ID7PBEMPHL27JARON4XDJWJK4TOX2DJ6RA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.941373070 (104h6m45.538144102s) [noise=true , address=79.127.205.237:4234  , piece_id=7HTPOWTGA2GFYYSNDOOB5PNE44GPJKYVCZCEVFOUL24GJMJJC6EA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.941854421 (104h6m45.538625449s) [noise=true , address=64.49.13.138:4487    , piece_id=FOCEUSC64R5Q7ZOCWE5XKAZXSQDXLDUEQ6TACPWYY2PXRUR4LJZA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.942384626 (104h6m45.539155657s) [noise=true , address=45.91.116.6:4978     , piece_id=TCYHWUUEZNKGOGJ3OSHOJU7I5SXSO7NODMUFAF5HN67GYS66RRWA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.943308667 (104h6m45.5400797s) [noise=true , address=145.79.227.21:4483   , piece_id=7MSS7NE4SUWLFOU7KSAGCZ3IZVIJNSE56KHGRL3GCGQVJ3DKP4VQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.943609163 (104h6m45.540380198s) [noise=true , address=167.17.72.71:4811    , piece_id=YK6OJXQTR5AIHI5CYQYRRAU4UXGC4LHHEOK56UG4OKDKT3TI2UVA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.944346996 (104h6m45.54111803s) [noise=true , address=77.90.31.18:4812     , piece_id=GQUHTOY4SM5B2GRHCAFZEG5W5HKRXM3R42EHBDZVFPZC2DWG3WUA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.944371169 (104h6m45.541142202s) [noise=true , address=45.91.116.8:4068     , piece_id=Q6ERVQ3EO4ET54DDXKWHZWENPRY7FDEINMK5RVFT2YSFFPN3WVEQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.945840127 (104h6m45.54261116s) [noise=true , address=77.90.31.19:4848     , piece_id=M4SDGI2RIF2TAUL3YQAP5AQ345ZKHQYV4CGPXC4KKM55FU6TNSPQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.946047960 (104h6m45.542818985s) [noise=true , address=45.91.116.5:4308     , piece_id=Y4K77UYELRJEJAXBMBYBJ3SUJ7BNEOQ4NUCPLXWY24OBMVJIJWTA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.947317100 (104h6m45.544088132s) [noise=true , address=45.91.116.13:4170    , piece_id=R56YVTNBMRBVVY4J4JMTLQSJJ46DVY4CRQM6RIA2YNGA3CKPR7UQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.947712870 (104h6m45.544483904s) [noise=true , address=77.90.31.15:4713     , piece_id=7FAXWQKYDTYUAAZGKIVFZC4534BJDJ4SEJFBJO335WCRSDRUHZAQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.948608160 (104h6m45.545379198s) [noise=true , address=77.90.31.17:4786     , piece_id=FJJFNH5LLXEJ3AU3O2WLI5F7TU6LESJZQY72Q7O27QLRK5KOVLNQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.948926354 (104h6m45.545697388s) [noise=true , address=77.90.31.10:4535     , piece_id=AQ3Z632XLGXGOTGTZUIVK53Q5NXGFMWCVYYLOHTJWURBAP6HQK4Q, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.949957787 (104h6m45.546728825s) [noise=true , address=79.127.219.45:4881   , piece_id=K6IU7ZLP5S7YK6SPIRSQH4EDSPDS57MB3T5FPMVIL6BEH257LM7Q, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.951273293 (104h6m45.548044327s) [noise=true , address=79.127.205.234:4181  , piece_id=UD6B44BMN7H2WK3P2TIIAUFKZB2K6PH3EEIFBAVFED2Q53TQDDZQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.951829900 (104h6m45.548600934s) [noise=true , address=79.127.219.41:4937   , piece_id=TB2LRED4R7QC7R2QMD5ZGRC6236JKDGO7KZLDKCC4K7M676YPQMQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:48.036482492 (104h6m45.633253551s) [upload=116529]: Next returned nil segment
Mar 10 19:06:48.036501010 (104h6m45.633272043s) [upload=116529]: Waiting for error group managing segments...
Mar 10 19:06:48.042266571 (104h6m45.639037584s) [noise=true , address=45.91.116.14:4222    , piece_id=DN3SNW3LKHWHUL6B3PAS5P7OG44ZDWKQXKKOPU53LJDSKXKNBREQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.043683514 (104h6m45.640454543s) [noise=true , address=145.79.227.21:4483   , piece_id=7MSS7NE4SUWLFOU7KSAGCZ3IZVIJNSE56KHGRL3GCGQVJ3DKP4VQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.044327860 (104h6m45.641098874s) [noise=true , address=79.127.219.45:4881   , piece_id=K6IU7ZLP5S7YK6SPIRSQH4EDSPDS57MB3T5FPMVIL6BEH257LM7Q, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.046521721 (104h6m45.643292745s) [noise=true , address=79.127.219.41:4937   , piece_id=TB2LRED4R7QC7R2QMD5ZGRC6236JKDGO7KZLDKCC4K7M676YPQMQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.049264342 (104h6m45.646035356s) [noise=true , address=45.91.116.13:4170    , piece_id=R56YVTNBMRBVVY4J4JMTLQSJJ46DVY4CRQM6RIA2YNGA3CKPR7UQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.051826600 (104h6m45.648597629s) [noise=true , address=45.91.116.8:4068     , piece_id=Q6ERVQ3EO4ET54DDXKWHZWENPRY7FDEINMK5RVFT2YSFFPN3WVEQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.053239446 (104h6m45.65001047s) [noise=true , address=45.91.116.5:4308     , piece_id=Y4K77UYELRJEJAXBMBYBJ3SUJ7BNEOQ4NUCPLXWY24OBMVJIJWTA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.057554590 (104h6m45.654325622s) [noise=true , address=45.91.116.6:4978     , piece_id=TCYHWUUEZNKGOGJ3OSHOJU7I5SXSO7NODMUFAF5HN67GYS66RRWA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.347909714 (104h6m45.944680732s) [noise=true , address=167.17.72.71:4811    , piece_id=YK6OJXQTR5AIHI5CYQYRRAU4UXGC4LHHEOK56UG4OKDKT3TI2UVA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.497098288 (104h6m46.093869316s) [noise=true , address=79.127.205.234:4181  , piece_id=UD6B44BMN7H2WK3P2TIIAUFKZB2K6PH3EEIFBAVFED2Q53TQDDZQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.524549543 (104h6m46.121320561s) [noise=true , address=64.49.13.154:4928    , piece_id=VQSF7TC2IYV4S52MG3ID7PBEMPHL27JARON4XDJWJK4TOX2DJ6RA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.567475047 (104h6m46.164246061s) [noise=true , address=64.49.13.138:4487    , piece_id=FOCEUSC64R5Q7ZOCWE5XKAZXSQDXLDUEQ6TACPWYY2PXRUR4LJZA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:49.393957509 (104h6m46.990728537s) [noise=true , address=79.127.205.237:4234  , piece_id=7HTPOWTGA2GFYYSNDOOB5PNE44GPJKYVCZCEVFOUL24GJMJJC6EA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:07:47.865864834 (104h7m45.462635862s) [noise=true , address=77.90.31.19:4848     , piece_id=M4SDGI2RIF2TAUL3YQAP5AQ345ZKHQYV4CGPXC4KKM55FU6TNSPQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD, address:77.90.31.19:4848): protocol: write tcp 159.223.143.39:35766->77.90.31.19:4848: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866066060 (104h7m45.462837092s) [noise=true , address=77.90.31.15:4713     , piece_id=7FAXWQKYDTYUAAZGKIVFZC4534BJDJ4SEJFBJO335WCRSDRUHZAQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:1Liv9RcEgfjxodPuadijzkcUGgJEy7LfKqHGFhaJCKbcxKkNN8, address:77.90.31.15:4713): protocol: rpc: dial tcp 77.90.31.15:4713: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866185581 (104h7m45.462956607s) [noise=true , address=77.90.31.18:4812     , piece_id=GQUHTOY4SM5B2GRHCAFZEG5W5HKRXM3R42EHBDZVFPZC2DWG3WUA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: write tcp 159.223.143.39:44376->77.90.31.18:4812: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866263516 (104h7m45.463034544s) [noise=true , address=77.90.31.10:4535     , piece_id=AQ3Z632XLGXGOTGTZUIVK53Q5NXGFMWCVYYLOHTJWURBAP6HQK4Q, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz, address:77.90.31.10:4535): protocol: write tcp 159.223.143.39:48368->77.90.31.10:4535: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866517656 (104h7m45.463288691s) [noise=true , address=77.90.31.17:4786     , piece_id=FJJFNH5LLXEJ3AU3O2WLI5F7TU6LESJZQY72Q7O27QLRK5KOVLNQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:128QrekLqpXLAJs7yqNziNLmt2i13SuMx1ZhMPdUpDosw71dgQh, address:77.90.31.17:4786): protocol: write tcp 159.223.143.39:40520->77.90.31.17:4786: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866574294 (104h7m45.463345325s) [seg_pos={0 0}, upload=116529]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:07:47.888227569 (104h7m45.484998602s) [upload=116529]: Done uploading segments...
Mar 10 19:07:47.888332065 (104h7m45.485103168s) [upload=116529]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 6.782745724s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [.....................X.......X.............X....X..........X]
duration: 
1m0.02504049s
trace: 
https://jaeger.dev.storj.io/trace/21780b32410ce66
FAIL (2026-03-10 19:07:47 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
116529]: Got next segment. Inline: false
Mar 10 19:06:47.907812827 (104h6m45.504583852s) [upload=116529]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:06:47.907821925 (104h6m45.504592955s) [upload=116529]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:06:47.940557630 (104h6m45.537328665s) [seg_pos={0 0}, upload=116529]: Begin upload segment...
Mar 10 19:06:47.940626826 (104h6m45.537397872s) [seg_pos={0 0}, upload=116529]: Done begin upload segment.
Mar 10 19:06:47.940664974 (104h6m45.537436009s) [noise=true , address=45.91.116.14:4222    , piece_id=DN3SNW3LKHWHUL6B3PAS5P7OG44ZDWKQXKKOPU53LJDSKXKNBREQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.940762459 (104h6m45.537533493s) [noise=true , address=64.49.13.154:4928    , piece_id=VQSF7TC2IYV4S52MG3ID7PBEMPHL27JARON4XDJWJK4TOX2DJ6RA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.941373070 (104h6m45.538144102s) [noise=true , address=79.127.205.237:4234  , piece_id=7HTPOWTGA2GFYYSNDOOB5PNE44GPJKYVCZCEVFOUL24GJMJJC6EA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.941854421 (104h6m45.538625449s) [noise=true , address=64.49.13.138:4487    , piece_id=FOCEUSC64R5Q7ZOCWE5XKAZXSQDXLDUEQ6TACPWYY2PXRUR4LJZA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.942384626 (104h6m45.539155657s) [noise=true , address=45.91.116.6:4978     , piece_id=TCYHWUUEZNKGOGJ3OSHOJU7I5SXSO7NODMUFAF5HN67GYS66RRWA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.943308667 (104h6m45.5400797s) [noise=true , address=145.79.227.21:4483   , piece_id=7MSS7NE4SUWLFOU7KSAGCZ3IZVIJNSE56KHGRL3GCGQVJ3DKP4VQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.943609163 (104h6m45.540380198s) [noise=true , address=167.17.72.71:4811    , piece_id=YK6OJXQTR5AIHI5CYQYRRAU4UXGC4LHHEOK56UG4OKDKT3TI2UVA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.944346996 (104h6m45.54111803s) [noise=true , address=77.90.31.18:4812     , piece_id=GQUHTOY4SM5B2GRHCAFZEG5W5HKRXM3R42EHBDZVFPZC2DWG3WUA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.944371169 (104h6m45.541142202s) [noise=true , address=45.91.116.8:4068     , piece_id=Q6ERVQ3EO4ET54DDXKWHZWENPRY7FDEINMK5RVFT2YSFFPN3WVEQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.945840127 (104h6m45.54261116s) [noise=true , address=77.90.31.19:4848     , piece_id=M4SDGI2RIF2TAUL3YQAP5AQ345ZKHQYV4CGPXC4KKM55FU6TNSPQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.946047960 (104h6m45.542818985s) [noise=true , address=45.91.116.5:4308     , piece_id=Y4K77UYELRJEJAXBMBYBJ3SUJ7BNEOQ4NUCPLXWY24OBMVJIJWTA, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.947317100 (104h6m45.544088132s) [noise=true , address=45.91.116.13:4170    , piece_id=R56YVTNBMRBVVY4J4JMTLQSJJ46DVY4CRQM6RIA2YNGA3CKPR7UQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.947712870 (104h6m45.544483904s) [noise=true , address=77.90.31.15:4713     , piece_id=7FAXWQKYDTYUAAZGKIVFZC4534BJDJ4SEJFBJO335WCRSDRUHZAQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.948608160 (104h6m45.545379198s) [noise=true , address=77.90.31.17:4786     , piece_id=FJJFNH5LLXEJ3AU3O2WLI5F7TU6LESJZQY72Q7O27QLRK5KOVLNQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.948926354 (104h6m45.545697388s) [noise=true , address=77.90.31.10:4535     , piece_id=AQ3Z632XLGXGOTGTZUIVK53Q5NXGFMWCVYYLOHTJWURBAP6HQK4Q, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.949957787 (104h6m45.546728825s) [noise=true , address=79.127.219.45:4881   , piece_id=K6IU7ZLP5S7YK6SPIRSQH4EDSPDS57MB3T5FPMVIL6BEH257LM7Q, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.951273293 (104h6m45.548044327s) [noise=true , address=79.127.205.234:4181  , piece_id=UD6B44BMN7H2WK3P2TIIAUFKZB2K6PH3EEIFBAVFED2Q53TQDDZQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:47.951829900 (104h6m45.548600934s) [noise=true , address=79.127.219.41:4937   , piece_id=TB2LRED4R7QC7R2QMD5ZGRC6236JKDGO7KZLDKCC4K7M676YPQMQ, seg_pos={0 0}, upload=116529]: Uploading piece...
Mar 10 19:06:48.036482492 (104h6m45.633253551s) [upload=116529]: Next returned nil segment
Mar 10 19:06:48.036501010 (104h6m45.633272043s) [upload=116529]: Waiting for error group managing segments...
Mar 10 19:06:48.042266571 (104h6m45.639037584s) [noise=true , address=45.91.116.14:4222    , piece_id=DN3SNW3LKHWHUL6B3PAS5P7OG44ZDWKQXKKOPU53LJDSKXKNBREQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.043683514 (104h6m45.640454543s) [noise=true , address=145.79.227.21:4483   , piece_id=7MSS7NE4SUWLFOU7KSAGCZ3IZVIJNSE56KHGRL3GCGQVJ3DKP4VQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.044327860 (104h6m45.641098874s) [noise=true , address=79.127.219.45:4881   , piece_id=K6IU7ZLP5S7YK6SPIRSQH4EDSPDS57MB3T5FPMVIL6BEH257LM7Q, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.046521721 (104h6m45.643292745s) [noise=true , address=79.127.219.41:4937   , piece_id=TB2LRED4R7QC7R2QMD5ZGRC6236JKDGO7KZLDKCC4K7M676YPQMQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.049264342 (104h6m45.646035356s) [noise=true , address=45.91.116.13:4170    , piece_id=R56YVTNBMRBVVY4J4JMTLQSJJ46DVY4CRQM6RIA2YNGA3CKPR7UQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.051826600 (104h6m45.648597629s) [noise=true , address=45.91.116.8:4068     , piece_id=Q6ERVQ3EO4ET54DDXKWHZWENPRY7FDEINMK5RVFT2YSFFPN3WVEQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.053239446 (104h6m45.65001047s) [noise=true , address=45.91.116.5:4308     , piece_id=Y4K77UYELRJEJAXBMBYBJ3SUJ7BNEOQ4NUCPLXWY24OBMVJIJWTA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.057554590 (104h6m45.654325622s) [noise=true , address=45.91.116.6:4978     , piece_id=TCYHWUUEZNKGOGJ3OSHOJU7I5SXSO7NODMUFAF5HN67GYS66RRWA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.347909714 (104h6m45.944680732s) [noise=true , address=167.17.72.71:4811    , piece_id=YK6OJXQTR5AIHI5CYQYRRAU4UXGC4LHHEOK56UG4OKDKT3TI2UVA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.497098288 (104h6m46.093869316s) [noise=true , address=79.127.205.234:4181  , piece_id=UD6B44BMN7H2WK3P2TIIAUFKZB2K6PH3EEIFBAVFED2Q53TQDDZQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.524549543 (104h6m46.121320561s) [noise=true , address=64.49.13.154:4928    , piece_id=VQSF7TC2IYV4S52MG3ID7PBEMPHL27JARON4XDJWJK4TOX2DJ6RA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:48.567475047 (104h6m46.164246061s) [noise=true , address=64.49.13.138:4487    , piece_id=FOCEUSC64R5Q7ZOCWE5XKAZXSQDXLDUEQ6TACPWYY2PXRUR4LJZA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:06:49.393957509 (104h6m46.990728537s) [noise=true , address=79.127.205.237:4234  , piece_id=7HTPOWTGA2GFYYSNDOOB5PNE44GPJKYVCZCEVFOUL24GJMJJC6EA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: <nil>
Mar 10 19:07:47.865864834 (104h7m45.462635862s) [noise=true , address=77.90.31.19:4848     , piece_id=M4SDGI2RIF2TAUL3YQAP5AQ345ZKHQYV4CGPXC4KKM55FU6TNSPQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD, address:77.90.31.19:4848): protocol: write tcp 159.223.143.39:35766->77.90.31.19:4848: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866066060 (104h7m45.462837092s) [noise=true , address=77.90.31.15:4713     , piece_id=7FAXWQKYDTYUAAZGKIVFZC4534BJDJ4SEJFBJO335WCRSDRUHZAQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:1Liv9RcEgfjxodPuadijzkcUGgJEy7LfKqHGFhaJCKbcxKkNN8, address:77.90.31.15:4713): protocol: rpc: dial tcp 77.90.31.15:4713: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866185581 (104h7m45.462956607s) [noise=true , address=77.90.31.18:4812     , piece_id=GQUHTOY4SM5B2GRHCAFZEG5W5HKRXM3R42EHBDZVFPZC2DWG3WUA, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: write tcp 159.223.143.39:44376->77.90.31.18:4812: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866263516 (104h7m45.463034544s) [noise=true , address=77.90.31.10:4535     , piece_id=AQ3Z632XLGXGOTGTZUIVK53Q5NXGFMWCVYYLOHTJWURBAP6HQK4Q, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz, address:77.90.31.10:4535): protocol: write tcp 159.223.143.39:48368->77.90.31.10:4535: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866517656 (104h7m45.463288691s) [noise=true , address=77.90.31.17:4786     , piece_id=FJJFNH5LLXEJ3AU3O2WLI5F7TU6LESJZQY72Q7O27QLRK5KOVLNQ, seg_pos={0 0}, upload=116529]: Done uploading piece. err: ecclient: upload failed (node:128QrekLqpXLAJs7yqNziNLmt2i13SuMx1ZhMPdUpDosw71dgQh, address:77.90.31.17:4786): protocol: write tcp 159.223.143.39:40520->77.90.31.17:4786: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:07:47.866574294 (104h7m45.463345325s) [seg_pos={0 0}, upload=116529]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:07:47.888227569 (104h7m45.484998602s) [upload=116529]: Done uploading segments...
Mar 10 19:07:47.888332065 (104h7m45.485103168s) [upload=116529]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.025066687s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [....X.......................................................]
duration: 
743.480325ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:07:28 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 743.506507ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [...........................X...X...X...................X....]
duration: 
1.218045337s
trace: 
https://jaeger.dev.storj.io/trace/6eaf7e5e6a726518
FAIL (2026-03-10 19:07:19 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 10 19:03:23.988246988 (104h3m21.585018018s) [upload=116469]: Starting upload
Mar 10 19:03:23.988312885 (104h3m21.585083919s) [upload=116469]: Done starting upload
Mar 10 19:03:23.988365267 (104h3m21.585136284s) [upload=116469]: Uploading segments...
Mar 10 19:03:23.988867979 (104h3m21.585639014s) [upload=116469]: Got next segment. Inline: false
Mar 10 19:03:23.988945739 (104h3m21.585716772s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:03:23.988952971 (104h3m21.585724005s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:03:24.019774719 (104h3m21.616545751s) [seg_pos={0 0}, upload=116469]: Begin upload segment...
Mar 10 19:03:24.019937835 (104h3m21.616708869s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.019981650 (104h3m21.616752677s) [seg_pos={0 0}, upload=116469]: Done begin upload segment.
Mar 10 19:03:24.020015989 (104h3m21.616787022s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.021928583 (104h3m21.618699617s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022484849 (104h3m21.619255883s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022762950 (104h3m21.619533983s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023221204 (104h3m21.619992237s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023336927 (104h3m21.620107969s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023765391 (104h3m21.620536423s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024157847 (104h3m21.620928871s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024176290 (104h3m21.620947323s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024230206 (104h3m21.621001229s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027199763 (104h3m21.623970797s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027808072 (104h3m21.624579102s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.028305994 (104h3m21.625077023s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029003543 (104h3m21.625774576s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029538948 (104h3m21.626309973s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.030274650 (104h3m21.627045683s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.032013478 (104h3m21.628784505s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.095600253 (104h3m21.692371268s) [upload=116469]: Next returned nil segment
Mar 10 19:03:24.095613852 (104h3m21.692384876s) [upload=116469]: Waiting for error group managing segments...
Mar 10 19:03:24.098625718 (104h3m21.695396745s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.099652296 (104h3m21.69642332s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.110953983 (104h3m21.707724996s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.118406692 (104h3m21.715177705s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.120589152 (104h3m21.717360176s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.122357574 (104h3m21.719128587s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.129335989 (104h3m21.726107017s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.391666873 (104h3m21.988437897s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.402782831 (104h3m21.999553857s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.590224293 (104h3m22.18699531s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.609965381 (104h3m22.206736393s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.617983306 (104h3m22.214754335s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.618344030 (104h3m22.215115053s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:04:23.953044817 (104h4m21.549815854s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953336512 (104h4m21.550107545s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: rpc: dial tcp 77.90.31.18:4812: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953405756 (104h4m21.550176788s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW, address:77.90.31.11:4574): protocol: rpc: dial tcp 77.90.31.11:4574: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953728735 (104h4m21.550499767s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953818559 (104h4m21.550589577s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c, address:77.90.31.19:4858): protocol: write tcp 159.223.143.39:44754->77.90.31.19:4858: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953865997 (104h4m21.550637012s) [seg_pos={0 0}, upload=116469]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:04:23.975449925 (104h4m21.572220956s) [upload=116469]: Done uploading segments...
Mar 10 19:04:23.975517148 (104h4m21.572288184s) [upload=116469]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.218104715s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [.........X..................X...............................]
duration: 
624.184709ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:07:06 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 624.263277ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [.....X......................................................]
duration: 
504.473334ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:07:01 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 504.503956ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [............................X...X...X...................X...]
duration: 
1.295278433s
trace: 
https://jaeger.dev.storj.io/trace/6eaf7e5e6a726518
FAIL (2026-03-10 19:06:44 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 10 19:03:23.988246988 (104h3m21.585018018s) [upload=116469]: Starting upload
Mar 10 19:03:23.988312885 (104h3m21.585083919s) [upload=116469]: Done starting upload
Mar 10 19:03:23.988365267 (104h3m21.585136284s) [upload=116469]: Uploading segments...
Mar 10 19:03:23.988867979 (104h3m21.585639014s) [upload=116469]: Got next segment. Inline: false
Mar 10 19:03:23.988945739 (104h3m21.585716772s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:03:23.988952971 (104h3m21.585724005s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:03:24.019774719 (104h3m21.616545751s) [seg_pos={0 0}, upload=116469]: Begin upload segment...
Mar 10 19:03:24.019937835 (104h3m21.616708869s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.019981650 (104h3m21.616752677s) [seg_pos={0 0}, upload=116469]: Done begin upload segment.
Mar 10 19:03:24.020015989 (104h3m21.616787022s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.021928583 (104h3m21.618699617s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022484849 (104h3m21.619255883s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022762950 (104h3m21.619533983s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023221204 (104h3m21.619992237s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023336927 (104h3m21.620107969s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023765391 (104h3m21.620536423s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024157847 (104h3m21.620928871s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024176290 (104h3m21.620947323s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024230206 (104h3m21.621001229s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027199763 (104h3m21.623970797s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027808072 (104h3m21.624579102s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.028305994 (104h3m21.625077023s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029003543 (104h3m21.625774576s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029538948 (104h3m21.626309973s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.030274650 (104h3m21.627045683s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.032013478 (104h3m21.628784505s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.095600253 (104h3m21.692371268s) [upload=116469]: Next returned nil segment
Mar 10 19:03:24.095613852 (104h3m21.692384876s) [upload=116469]: Waiting for error group managing segments...
Mar 10 19:03:24.098625718 (104h3m21.695396745s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.099652296 (104h3m21.69642332s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.110953983 (104h3m21.707724996s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.118406692 (104h3m21.715177705s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.120589152 (104h3m21.717360176s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.122357574 (104h3m21.719128587s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.129335989 (104h3m21.726107017s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.391666873 (104h3m21.988437897s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.402782831 (104h3m21.999553857s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.590224293 (104h3m22.18699531s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.609965381 (104h3m22.206736393s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.617983306 (104h3m22.214754335s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.618344030 (104h3m22.215115053s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:04:23.953044817 (104h4m21.549815854s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953336512 (104h4m21.550107545s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: rpc: dial tcp 77.90.31.18:4812: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953405756 (104h4m21.550176788s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW, address:77.90.31.11:4574): protocol: rpc: dial tcp 77.90.31.11:4574: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953728735 (104h4m21.550499767s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953818559 (104h4m21.550589577s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c, address:77.90.31.19:4858): protocol: write tcp 159.223.143.39:44754->77.90.31.19:4858: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953865997 (104h4m21.550637012s) [seg_pos={0 0}, upload=116469]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:04:23.975449925 (104h4m21.572220956s) [upload=116469]: Done uploading segments...
Mar 10 19:04:23.975517148 (104h4m21.572288184s) [upload=116469]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.295313287s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [..........X..................X..............................]
duration: 
702.384832ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:06:35 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 702.409544ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [......................X.......X.............X....X..........]
duration: 
1.331597413s
trace: 
https://jaeger.dev.storj.io/trace/5551066fb24b6624
FAIL (2026-03-10 19:06:21 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
 [upload=116365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 18:57:27.484826534 (103h57m25.081597557s) [upload=116365]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 18:57:27.521721468 (103h57m25.11849248s) [seg_pos={0 0}, upload=116365]: Begin upload segment...
Mar 10 18:57:27.521868020 (103h57m25.118639046s) [seg_pos={0 0}, upload=116365]: Done begin upload segment.
Mar 10 18:57:27.521902956 (103h57m25.118673979s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.521983909 (103h57m25.118754933s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.523613945 (103h57m25.120384968s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524285299 (103h57m25.121056331s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524949601 (103h57m25.121720624s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525484827 (103h57m25.12225585s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525969502 (103h57m25.122740528s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.526481271 (103h57m25.123252294s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527363350 (103h57m25.124134383s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527903397 (103h57m25.12467443s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.528459198 (103h57m25.125230242s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529239126 (103h57m25.12601015s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529855918 (103h57m25.126626944s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.530483568 (103h57m25.1272546s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531044521 (103h57m25.127815545s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531608342 (103h57m25.128379366s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532233632 (103h57m25.12900466s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532810194 (103h57m25.129581217s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.598647582 (103h57m25.195418592s) [upload=116365]: Next returned nil segment
Mar 10 18:57:27.598660671 (103h57m25.195431693s) [upload=116365]: Waiting for error group managing segments...
Mar 10 18:57:27.617260011 (103h57m25.214031035s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623564891 (103h57m25.22033592s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623817360 (103h57m25.220588374s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.624221744 (103h57m25.220992769s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.627462959 (103h57m25.224233983s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.654127655 (103h57m25.250898681s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.900823571 (103h57m25.497594593s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.063905047 (103h57m25.660676071s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.073501018 (103h57m25.670272043s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.113442671 (103h57m25.710213697s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.120035234 (103h57m25.716806258s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.191954998 (103h57m25.788726025s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:58:27.450793500 (103h58m25.047564535s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw, address:77.90.31.18:4815): protocol: rpc: dial tcp 77.90.31.18:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.450883537 (103h58m25.04765457s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh, address:77.90.31.21:4900): protocol: rpc: dial tcp 77.90.31.21:4900: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451074703 (103h58m25.047845735s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1kSxoZb9nmG6oGNytpFTsoiGh3ZPmebVVe8TZxGzANaw7EfdeF, address:77.90.31.12:4593): protocol: rpc: dial tcp 77.90.31.12:4593: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451150309 (103h58m25.047921346s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451331738 (103h58m25.048102771s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx, address:77.90.31.17:4789): protocol: context deadline exceeded; context deadline exceeded
Mar 10 18:58:27.451342106 (103h58m25.048113141s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd, address:77.90.31.16:4738): protocol: write tcp 159.223.143.39:37834->77.90.31.16:4738: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451368018 (103h58m25.048139029s) [seg_pos={0 0}, upload=116365]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 10 18:58:27.484713412 (103h58m25.08148443s) [upload=116365]: Done uploading segments...
Mar 10 18:58:27.484792918 (103h58m25.081563946s) [upload=116365]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1.331621722s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
3 out of 60 is failed (threshold=3) [.X..X................................................X......]
duration: 
5.498668519s
trace: 
https://jaeger.dev.storj.io/trace/41fc19646dedf2b
FAIL (2026-03-10 19:06:17 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
59:48.871752042 (103h59m46.468523065s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.871766366 (103h59m46.468537394s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872236431 (103h59m46.469007465s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872476023 (103h59m46.469247056s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872642319 (103h59m46.469413365s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873017409 (103h59m46.469788442s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873112445 (103h59m46.469883471s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873504435 (103h59m46.470275458s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873518754 (103h59m46.470289784s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873935290 (103h59m46.470706313s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873941072 (103h59m46.470712101s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.878089390 (103h59m46.474860423s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:49.248411606 (103h59m46.84518263s) [upload=116406]: Next returned nil segment
Mar 10 18:59:49.248425455 (103h59m46.845196479s) [upload=116406]: Waiting for error group managing segments...
Mar 10 18:59:49.474071618 (103h59m47.070842642s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.480292316 (103h59m47.07706334s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.489340334 (103h59m47.086111357s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.504000682 (103h59m47.100771706s) [noise=true , address=81.171.14.70:4025    , piece_id=D34FMTR4XLUI6HWNTNBC6ESS42BC33F4WYA4ABR2CHJJ6H5S7YIQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.532473713 (103h59m47.129244742s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.537613891 (103h59m47.134384904s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549489567 (103h59m47.146260589s) [noise=true , address=89.149.201.147:4014  , piece_id=5Q7HBKB3WLFUKAGWJ64IXNCXPAATDIFUCYN6N2V2XSDH2VWBLWJA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549783369 (103h59m47.146554395s) [noise=true , address=89.149.201.147:4010  , piece_id=WRP553BFHMTHKDA52R4B27FRRYDITSUXJMWZIQGETJQ534RXOSOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.550944998 (103h59m47.147716022s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.552358477 (103h59m47.1491295s) [noise=true , address=185.167.204.206:4066 , piece_id=LY33PR2OIW6UHZDFP453BGMG6IRJEYTTU7WD3JFPEFLQP6ERGUOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.556323257 (103h59m47.153094271s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.557938128 (103h59m47.154709158s) [noise=true , address=185.167.204.205:4030 , piece_id=FMVAQDEEBV2O4IVQDOLXUKF3DSDMDBM7J2WAHQ5LL3XIQDEXDXAA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558180752 (103h59m47.154951776s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558651610 (103h59m47.155422634s) [noise=true , address=89.149.201.147:4009  , piece_id=6DUG4IKPT57NLKPPLQYBMBHICPG65BHRZCTTIGFJZJ5253XU42BA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558678943 (103h59m47.155449966s) [noise=true , address=89.149.201.147:4023  , piece_id=2SU7S4JGCLGDYZUJAP7R7M4NNEMLHTRNLZQV2APBOGBK3WDKDYZQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.575712930 (103h59m47.172483953s) [noise=true , address=185.167.204.206:4060 , piece_id=G6JD5YY4L3BVJADVWRRKCJFBFKR7LK2XL2YSVCMFUBCRALB2G2AQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.593797789 (103h59m47.190568818s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.598510090 (103h59m47.195281116s) [noise=true , address=89.149.201.147:4012  , piece_id=OT7VVAXSBT262LDOIQPT4LGSBAGQ7ICJEVBGXM7UYUINPES5DI2A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.641662861 (103h59m47.238433876s) [noise=true , address=185.167.204.206:4054 , piece_id=OMEHHTI27QJPSX4YA6ZF4EQR22JY2XGU6FHLI65P5YNXVOQGAL3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.048638281 (103h59m47.645409304s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.109812159 (103h59m47.706583181s) [noise=true , address=185.167.204.205:4019 , piece_id=GCHTNKUHMMKWJ2QHDFLO5EHTWNWL33MXYBTM3WAWF773XBWZHX6A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:51.470994001 (103h59m49.067765025s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.215239364 (103h59m49.812010379s) [noise=true , address=185.167.204.206:4056 , piece_id=T4SSK3GQ32JLSSCBFTQGWNEB3SI6VGJBOQDIIJSBOHIVCDMEEZAQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.415825498 (103h59m50.012596522s) [noise=true , address=185.167.204.206:4063 , piece_id=NYAMWJ6LZSW5BZS3EZRO2HSOCICIEMSVLZ3FF3W764VSDDBJR7KQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:53.171677840 (103h59m50.768448864s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 19:00:48.501538387 (104h0m46.09830942s) [noise=true , address=89.149.201.147:4001  , piece_id=YLIRWGW7D6LGIDT5Q475DY7LZDSLNP5DB6UETRFQ6GZALNBQTDWQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:54340->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501665952 (104h0m46.09843697s) [noise=true , address=89.149.201.147:4007  , piece_id=ZNB53UYB4VYMTUBTT2YEOSAXDZVTEATKM5YZGQNS6SWDNFUBMQFQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33044->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501953179 (104h0m46.09872421s) [noise=true , address=89.149.201.147:4006  , piece_id=4UFBWFA5SK7BKB6EGF6HW6MSQPKKMJKXZDHW6UNDS3I6TP3TLFYA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU, address:89.149.201.147:4006): protocol: read tcp 159.223.143.39:60806->89.149.201.147:4006: use of closed network connection; context deadline exceeded
Mar 10 19:00:48.501990253 (104h0m46.09876127s) [seg_pos={0 0}, upload=116406]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 19:00:48.600564516 (104h0m46.197335537s) [upload=116406]: Done uploading segments...
Mar 10 19:00:48.600611284 (104h0m46.197382321s) [upload=116406]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 5.498702836s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [......X.....................................................]
duration: 
477.681069ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:06:03 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 477.817467ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [...........X..................X.............................]
duration: 
968.03482ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:05:46 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 968.0691ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [.......X....................................................]
duration: 
440.439375ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:05:44 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 440.482118ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
3 out of 60 is failed (threshold=3) [..X..X................................................X.....]
duration: 
26.900905655s
trace: 
https://jaeger.dev.storj.io/trace/41fc19646dedf2b
FAIL (2026-03-10 19:05:40 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
59:48.871752042 (103h59m46.468523065s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.871766366 (103h59m46.468537394s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872236431 (103h59m46.469007465s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872476023 (103h59m46.469247056s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872642319 (103h59m46.469413365s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873017409 (103h59m46.469788442s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873112445 (103h59m46.469883471s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873504435 (103h59m46.470275458s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873518754 (103h59m46.470289784s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873935290 (103h59m46.470706313s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873941072 (103h59m46.470712101s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.878089390 (103h59m46.474860423s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:49.248411606 (103h59m46.84518263s) [upload=116406]: Next returned nil segment
Mar 10 18:59:49.248425455 (103h59m46.845196479s) [upload=116406]: Waiting for error group managing segments...
Mar 10 18:59:49.474071618 (103h59m47.070842642s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.480292316 (103h59m47.07706334s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.489340334 (103h59m47.086111357s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.504000682 (103h59m47.100771706s) [noise=true , address=81.171.14.70:4025    , piece_id=D34FMTR4XLUI6HWNTNBC6ESS42BC33F4WYA4ABR2CHJJ6H5S7YIQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.532473713 (103h59m47.129244742s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.537613891 (103h59m47.134384904s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549489567 (103h59m47.146260589s) [noise=true , address=89.149.201.147:4014  , piece_id=5Q7HBKB3WLFUKAGWJ64IXNCXPAATDIFUCYN6N2V2XSDH2VWBLWJA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549783369 (103h59m47.146554395s) [noise=true , address=89.149.201.147:4010  , piece_id=WRP553BFHMTHKDA52R4B27FRRYDITSUXJMWZIQGETJQ534RXOSOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.550944998 (103h59m47.147716022s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.552358477 (103h59m47.1491295s) [noise=true , address=185.167.204.206:4066 , piece_id=LY33PR2OIW6UHZDFP453BGMG6IRJEYTTU7WD3JFPEFLQP6ERGUOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.556323257 (103h59m47.153094271s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.557938128 (103h59m47.154709158s) [noise=true , address=185.167.204.205:4030 , piece_id=FMVAQDEEBV2O4IVQDOLXUKF3DSDMDBM7J2WAHQ5LL3XIQDEXDXAA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558180752 (103h59m47.154951776s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558651610 (103h59m47.155422634s) [noise=true , address=89.149.201.147:4009  , piece_id=6DUG4IKPT57NLKPPLQYBMBHICPG65BHRZCTTIGFJZJ5253XU42BA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558678943 (103h59m47.155449966s) [noise=true , address=89.149.201.147:4023  , piece_id=2SU7S4JGCLGDYZUJAP7R7M4NNEMLHTRNLZQV2APBOGBK3WDKDYZQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.575712930 (103h59m47.172483953s) [noise=true , address=185.167.204.206:4060 , piece_id=G6JD5YY4L3BVJADVWRRKCJFBFKR7LK2XL2YSVCMFUBCRALB2G2AQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.593797789 (103h59m47.190568818s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.598510090 (103h59m47.195281116s) [noise=true , address=89.149.201.147:4012  , piece_id=OT7VVAXSBT262LDOIQPT4LGSBAGQ7ICJEVBGXM7UYUINPES5DI2A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.641662861 (103h59m47.238433876s) [noise=true , address=185.167.204.206:4054 , piece_id=OMEHHTI27QJPSX4YA6ZF4EQR22JY2XGU6FHLI65P5YNXVOQGAL3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.048638281 (103h59m47.645409304s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.109812159 (103h59m47.706583181s) [noise=true , address=185.167.204.205:4019 , piece_id=GCHTNKUHMMKWJ2QHDFLO5EHTWNWL33MXYBTM3WAWF773XBWZHX6A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:51.470994001 (103h59m49.067765025s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.215239364 (103h59m49.812010379s) [noise=true , address=185.167.204.206:4056 , piece_id=T4SSK3GQ32JLSSCBFTQGWNEB3SI6VGJBOQDIIJSBOHIVCDMEEZAQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.415825498 (103h59m50.012596522s) [noise=true , address=185.167.204.206:4063 , piece_id=NYAMWJ6LZSW5BZS3EZRO2HSOCICIEMSVLZ3FF3W764VSDDBJR7KQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:53.171677840 (103h59m50.768448864s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 19:00:48.501538387 (104h0m46.09830942s) [noise=true , address=89.149.201.147:4001  , piece_id=YLIRWGW7D6LGIDT5Q475DY7LZDSLNP5DB6UETRFQ6GZALNBQTDWQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:54340->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501665952 (104h0m46.09843697s) [noise=true , address=89.149.201.147:4007  , piece_id=ZNB53UYB4VYMTUBTT2YEOSAXDZVTEATKM5YZGQNS6SWDNFUBMQFQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33044->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501953179 (104h0m46.09872421s) [noise=true , address=89.149.201.147:4006  , piece_id=4UFBWFA5SK7BKB6EGF6HW6MSQPKKMJKXZDHW6UNDS3I6TP3TLFYA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU, address:89.149.201.147:4006): protocol: read tcp 159.223.143.39:60806->89.149.201.147:4006: use of closed network connection; context deadline exceeded
Mar 10 19:00:48.501990253 (104h0m46.09876127s) [seg_pos={0 0}, upload=116406]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 19:00:48.600564516 (104h0m46.197335537s) [upload=116406]: Done uploading segments...
Mar 10 19:00:48.600611284 (104h0m46.197382321s) [upload=116406]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 26.900939292s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.............................X...X...X...................X..]
duration: 
1.37974482s
trace: 
https://jaeger.dev.storj.io/trace/6eaf7e5e6a726518
FAIL (2026-03-10 19:05:31 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 10 19:03:23.988246988 (104h3m21.585018018s) [upload=116469]: Starting upload
Mar 10 19:03:23.988312885 (104h3m21.585083919s) [upload=116469]: Done starting upload
Mar 10 19:03:23.988365267 (104h3m21.585136284s) [upload=116469]: Uploading segments...
Mar 10 19:03:23.988867979 (104h3m21.585639014s) [upload=116469]: Got next segment. Inline: false
Mar 10 19:03:23.988945739 (104h3m21.585716772s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:03:23.988952971 (104h3m21.585724005s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:03:24.019774719 (104h3m21.616545751s) [seg_pos={0 0}, upload=116469]: Begin upload segment...
Mar 10 19:03:24.019937835 (104h3m21.616708869s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.019981650 (104h3m21.616752677s) [seg_pos={0 0}, upload=116469]: Done begin upload segment.
Mar 10 19:03:24.020015989 (104h3m21.616787022s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.021928583 (104h3m21.618699617s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022484849 (104h3m21.619255883s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022762950 (104h3m21.619533983s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023221204 (104h3m21.619992237s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023336927 (104h3m21.620107969s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023765391 (104h3m21.620536423s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024157847 (104h3m21.620928871s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024176290 (104h3m21.620947323s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024230206 (104h3m21.621001229s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027199763 (104h3m21.623970797s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027808072 (104h3m21.624579102s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.028305994 (104h3m21.625077023s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029003543 (104h3m21.625774576s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029538948 (104h3m21.626309973s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.030274650 (104h3m21.627045683s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.032013478 (104h3m21.628784505s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.095600253 (104h3m21.692371268s) [upload=116469]: Next returned nil segment
Mar 10 19:03:24.095613852 (104h3m21.692384876s) [upload=116469]: Waiting for error group managing segments...
Mar 10 19:03:24.098625718 (104h3m21.695396745s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.099652296 (104h3m21.69642332s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.110953983 (104h3m21.707724996s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.118406692 (104h3m21.715177705s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.120589152 (104h3m21.717360176s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.122357574 (104h3m21.719128587s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.129335989 (104h3m21.726107017s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.391666873 (104h3m21.988437897s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.402782831 (104h3m21.999553857s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.590224293 (104h3m22.18699531s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.609965381 (104h3m22.206736393s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.617983306 (104h3m22.214754335s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.618344030 (104h3m22.215115053s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:04:23.953044817 (104h4m21.549815854s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953336512 (104h4m21.550107545s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: rpc: dial tcp 77.90.31.18:4812: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953405756 (104h4m21.550176788s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW, address:77.90.31.11:4574): protocol: rpc: dial tcp 77.90.31.11:4574: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953728735 (104h4m21.550499767s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953818559 (104h4m21.550589577s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c, address:77.90.31.19:4858): protocol: write tcp 159.223.143.39:44754->77.90.31.19:4858: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953865997 (104h4m21.550637012s) [seg_pos={0 0}, upload=116469]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:04:23.975449925 (104h4m21.572220956s) [upload=116469]: Done uploading segments...
Mar 10 19:04:23.975517148 (104h4m21.572288184s) [upload=116469]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.379859813s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [........X...................................................]
duration: 
795.047266ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:05:28 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 795.074839ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.......................X.......X.............X....X.........]
duration: 
1.294878893s
trace: 
https://jaeger.dev.storj.io/trace/5551066fb24b6624
FAIL (2026-03-10 19:05:25 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
 [upload=116365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 18:57:27.484826534 (103h57m25.081597557s) [upload=116365]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 18:57:27.521721468 (103h57m25.11849248s) [seg_pos={0 0}, upload=116365]: Begin upload segment...
Mar 10 18:57:27.521868020 (103h57m25.118639046s) [seg_pos={0 0}, upload=116365]: Done begin upload segment.
Mar 10 18:57:27.521902956 (103h57m25.118673979s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.521983909 (103h57m25.118754933s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.523613945 (103h57m25.120384968s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524285299 (103h57m25.121056331s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524949601 (103h57m25.121720624s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525484827 (103h57m25.12225585s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525969502 (103h57m25.122740528s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.526481271 (103h57m25.123252294s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527363350 (103h57m25.124134383s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527903397 (103h57m25.12467443s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.528459198 (103h57m25.125230242s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529239126 (103h57m25.12601015s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529855918 (103h57m25.126626944s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.530483568 (103h57m25.1272546s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531044521 (103h57m25.127815545s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531608342 (103h57m25.128379366s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532233632 (103h57m25.12900466s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532810194 (103h57m25.129581217s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.598647582 (103h57m25.195418592s) [upload=116365]: Next returned nil segment
Mar 10 18:57:27.598660671 (103h57m25.195431693s) [upload=116365]: Waiting for error group managing segments...
Mar 10 18:57:27.617260011 (103h57m25.214031035s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623564891 (103h57m25.22033592s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623817360 (103h57m25.220588374s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.624221744 (103h57m25.220992769s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.627462959 (103h57m25.224233983s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.654127655 (103h57m25.250898681s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.900823571 (103h57m25.497594593s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.063905047 (103h57m25.660676071s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.073501018 (103h57m25.670272043s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.113442671 (103h57m25.710213697s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.120035234 (103h57m25.716806258s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.191954998 (103h57m25.788726025s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:58:27.450793500 (103h58m25.047564535s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw, address:77.90.31.18:4815): protocol: rpc: dial tcp 77.90.31.18:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.450883537 (103h58m25.04765457s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh, address:77.90.31.21:4900): protocol: rpc: dial tcp 77.90.31.21:4900: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451074703 (103h58m25.047845735s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1kSxoZb9nmG6oGNytpFTsoiGh3ZPmebVVe8TZxGzANaw7EfdeF, address:77.90.31.12:4593): protocol: rpc: dial tcp 77.90.31.12:4593: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451150309 (103h58m25.047921346s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451331738 (103h58m25.048102771s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx, address:77.90.31.17:4789): protocol: context deadline exceeded; context deadline exceeded
Mar 10 18:58:27.451342106 (103h58m25.048113141s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd, address:77.90.31.16:4738): protocol: write tcp 159.223.143.39:37834->77.90.31.16:4738: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451368018 (103h58m25.048139029s) [seg_pos={0 0}, upload=116365]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 10 18:58:27.484713412 (103h58m25.08148443s) [upload=116365]: Done uploading segments...
Mar 10 18:58:27.484792918 (103h58m25.081563946s) [upload=116365]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1.295041253s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [............X..................X............................]
duration: 
578.218192ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:05:18 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 578.249837ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [.............X..................X...........................]
duration: 
604.647991ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:04:42 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 604.676285ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [.........X..................................................]
duration: 
644.984278ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:04:37 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 645.032676ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [........................X.......X.............X....X........]
duration: 
1.425427197s
trace: 
https://jaeger.dev.storj.io/trace/5551066fb24b6624
FAIL (2026-03-10 19:04:30 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
 [upload=116365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 18:57:27.484826534 (103h57m25.081597557s) [upload=116365]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 18:57:27.521721468 (103h57m25.11849248s) [seg_pos={0 0}, upload=116365]: Begin upload segment...
Mar 10 18:57:27.521868020 (103h57m25.118639046s) [seg_pos={0 0}, upload=116365]: Done begin upload segment.
Mar 10 18:57:27.521902956 (103h57m25.118673979s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.521983909 (103h57m25.118754933s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.523613945 (103h57m25.120384968s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524285299 (103h57m25.121056331s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524949601 (103h57m25.121720624s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525484827 (103h57m25.12225585s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525969502 (103h57m25.122740528s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.526481271 (103h57m25.123252294s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527363350 (103h57m25.124134383s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527903397 (103h57m25.12467443s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.528459198 (103h57m25.125230242s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529239126 (103h57m25.12601015s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529855918 (103h57m25.126626944s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.530483568 (103h57m25.1272546s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531044521 (103h57m25.127815545s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531608342 (103h57m25.128379366s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532233632 (103h57m25.12900466s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532810194 (103h57m25.129581217s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.598647582 (103h57m25.195418592s) [upload=116365]: Next returned nil segment
Mar 10 18:57:27.598660671 (103h57m25.195431693s) [upload=116365]: Waiting for error group managing segments...
Mar 10 18:57:27.617260011 (103h57m25.214031035s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623564891 (103h57m25.22033592s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623817360 (103h57m25.220588374s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.624221744 (103h57m25.220992769s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.627462959 (103h57m25.224233983s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.654127655 (103h57m25.250898681s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.900823571 (103h57m25.497594593s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.063905047 (103h57m25.660676071s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.073501018 (103h57m25.670272043s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.113442671 (103h57m25.710213697s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.120035234 (103h57m25.716806258s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.191954998 (103h57m25.788726025s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:58:27.450793500 (103h58m25.047564535s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw, address:77.90.31.18:4815): protocol: rpc: dial tcp 77.90.31.18:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.450883537 (103h58m25.04765457s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh, address:77.90.31.21:4900): protocol: rpc: dial tcp 77.90.31.21:4900: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451074703 (103h58m25.047845735s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1kSxoZb9nmG6oGNytpFTsoiGh3ZPmebVVe8TZxGzANaw7EfdeF, address:77.90.31.12:4593): protocol: rpc: dial tcp 77.90.31.12:4593: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451150309 (103h58m25.047921346s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451331738 (103h58m25.048102771s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx, address:77.90.31.17:4789): protocol: context deadline exceeded; context deadline exceeded
Mar 10 18:58:27.451342106 (103h58m25.048113141s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd, address:77.90.31.16:4738): protocol: write tcp 159.223.143.39:37834->77.90.31.16:4738: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451368018 (103h58m25.048139029s) [seg_pos={0 0}, upload=116365]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 10 18:58:27.484713412 (103h58m25.08148443s) [upload=116365]: Done uploading segments...
Mar 10 18:58:27.484792918 (103h58m25.081563946s) [upload=116365]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1.425479262s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [..............................X...X...X...................X.]
duration: 
1.423158136s
trace: 
https://jaeger.dev.storj.io/trace/6eaf7e5e6a726518
FAIL (2026-03-10 19:04:25 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 10 19:03:23.988246988 (104h3m21.585018018s) [upload=116469]: Starting upload
Mar 10 19:03:23.988312885 (104h3m21.585083919s) [upload=116469]: Done starting upload
Mar 10 19:03:23.988365267 (104h3m21.585136284s) [upload=116469]: Uploading segments...
Mar 10 19:03:23.988867979 (104h3m21.585639014s) [upload=116469]: Got next segment. Inline: false
Mar 10 19:03:23.988945739 (104h3m21.585716772s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:03:23.988952971 (104h3m21.585724005s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:03:24.019774719 (104h3m21.616545751s) [seg_pos={0 0}, upload=116469]: Begin upload segment...
Mar 10 19:03:24.019937835 (104h3m21.616708869s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.019981650 (104h3m21.616752677s) [seg_pos={0 0}, upload=116469]: Done begin upload segment.
Mar 10 19:03:24.020015989 (104h3m21.616787022s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.021928583 (104h3m21.618699617s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022484849 (104h3m21.619255883s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022762950 (104h3m21.619533983s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023221204 (104h3m21.619992237s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023336927 (104h3m21.620107969s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023765391 (104h3m21.620536423s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024157847 (104h3m21.620928871s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024176290 (104h3m21.620947323s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024230206 (104h3m21.621001229s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027199763 (104h3m21.623970797s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027808072 (104h3m21.624579102s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.028305994 (104h3m21.625077023s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029003543 (104h3m21.625774576s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029538948 (104h3m21.626309973s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.030274650 (104h3m21.627045683s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.032013478 (104h3m21.628784505s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.095600253 (104h3m21.692371268s) [upload=116469]: Next returned nil segment
Mar 10 19:03:24.095613852 (104h3m21.692384876s) [upload=116469]: Waiting for error group managing segments...
Mar 10 19:03:24.098625718 (104h3m21.695396745s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.099652296 (104h3m21.69642332s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.110953983 (104h3m21.707724996s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.118406692 (104h3m21.715177705s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.120589152 (104h3m21.717360176s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.122357574 (104h3m21.719128587s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.129335989 (104h3m21.726107017s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.391666873 (104h3m21.988437897s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.402782831 (104h3m21.999553857s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.590224293 (104h3m22.18699531s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.609965381 (104h3m22.206736393s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.617983306 (104h3m22.214754335s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.618344030 (104h3m22.215115053s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:04:23.953044817 (104h4m21.549815854s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953336512 (104h4m21.550107545s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: rpc: dial tcp 77.90.31.18:4812: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953405756 (104h4m21.550176788s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW, address:77.90.31.11:4574): protocol: rpc: dial tcp 77.90.31.11:4574: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953728735 (104h4m21.550499767s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953818559 (104h4m21.550589577s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c, address:77.90.31.19:4858): protocol: write tcp 159.223.143.39:44754->77.90.31.19:4858: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953865997 (104h4m21.550637012s) [seg_pos={0 0}, upload=116469]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:04:23.975449925 (104h4m21.572220956s) [upload=116469]: Done uploading segments...
Mar 10 19:04:23.975517148 (104h4m21.572288184s) [upload=116469]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.423183101s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [...............................X...X...X...................X]
duration: 
1m0.025456955s
trace: 
https://jaeger.dev.storj.io/trace/6eaf7e5e6a726518
FAIL (2026-03-10 19:04:23 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 10 19:03:23.988246988 (104h3m21.585018018s) [upload=116469]: Starting upload
Mar 10 19:03:23.988312885 (104h3m21.585083919s) [upload=116469]: Done starting upload
Mar 10 19:03:23.988365267 (104h3m21.585136284s) [upload=116469]: Uploading segments...
Mar 10 19:03:23.988867979 (104h3m21.585639014s) [upload=116469]: Got next segment. Inline: false
Mar 10 19:03:23.988945739 (104h3m21.585716772s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 19:03:23.988952971 (104h3m21.585724005s) [upload=116469]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 19:03:24.019774719 (104h3m21.616545751s) [seg_pos={0 0}, upload=116469]: Begin upload segment...
Mar 10 19:03:24.019937835 (104h3m21.616708869s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.019981650 (104h3m21.616752677s) [seg_pos={0 0}, upload=116469]: Done begin upload segment.
Mar 10 19:03:24.020015989 (104h3m21.616787022s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.021928583 (104h3m21.618699617s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022484849 (104h3m21.619255883s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.022762950 (104h3m21.619533983s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023221204 (104h3m21.619992237s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023336927 (104h3m21.620107969s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.023765391 (104h3m21.620536423s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024157847 (104h3m21.620928871s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024176290 (104h3m21.620947323s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.024230206 (104h3m21.621001229s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027199763 (104h3m21.623970797s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.027808072 (104h3m21.624579102s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.028305994 (104h3m21.625077023s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029003543 (104h3m21.625774576s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.029538948 (104h3m21.626309973s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.030274650 (104h3m21.627045683s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.032013478 (104h3m21.628784505s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Uploading piece...
Mar 10 19:03:24.095600253 (104h3m21.692371268s) [upload=116469]: Next returned nil segment
Mar 10 19:03:24.095613852 (104h3m21.692384876s) [upload=116469]: Waiting for error group managing segments...
Mar 10 19:03:24.098625718 (104h3m21.695396745s) [noise=true , address=79.127.219.38:4826   , piece_id=NJIH3TJC5JWX2SVYBXNNKQUKJRON3F2QOOJCWWX4NEKLNOWVPCOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.099652296 (104h3m21.69642332s) [noise=true , address=79.127.219.46:4918   , piece_id=2C3Z3ZKBREVE5FBJQJAU5P7YA3QOCLNWE5FRCGZZC6LVATG4SLCA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.110953983 (104h3m21.707724996s) [noise=true , address=45.91.116.8:4063     , piece_id=FJWHPGLHW6F2PGNNX3HFATXH2FH4FBXPZRN74XMA2FMA6TISLZLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.118406692 (104h3m21.715177705s) [noise=true , address=45.91.116.9:4282     , piece_id=QT4ZZ6F6HRVWCFHTTTH6C5LDQPG2BSXGPASDABDTN2NM66IWSZVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.120589152 (104h3m21.717360176s) [noise=true , address=145.79.227.27:4723   , piece_id=IM6LEMDPE7H2NADQ4QEKUSDF4TF262B3KUTJQODV3IMMWWO5TMMA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.122357574 (104h3m21.719128587s) [noise=true , address=45.91.116.7:4039     , piece_id=CYSPTLQQCHOVHG55V4Z2UO6NXSKEU6DGYFNYK674TXGACL337SVQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.129335989 (104h3m21.726107017s) [noise=true , address=79.127.219.45:4860   , piece_id=KPEAUTG2ZEIZYQMX236IAET6ZJ5WGOTT25AGREIMDMO24U4DKLCQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.391666873 (104h3m21.988437897s) [noise=true , address=167.17.72.70:4767    , piece_id=XAA643AKGFHGCGIKOR22YLCIFKQR6GNC6DLH532BJDXZPMBUBXLQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.402782831 (104h3m21.999553857s) [noise=true , address=167.17.72.69:4725    , piece_id=KSJNOOTFYGCLV465E5QTSLQNM2QRA6XRINX4IHZYWNOF5E67ZLOQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.590224293 (104h3m22.18699531s) [noise=true , address=79.127.205.233:4150  , piece_id=4NWBOXUWJZW3NOXHSXXBJUVAYNOIQGZJTU6GVBR2KQVEDPJEXLOA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.609965381 (104h3m22.206736393s) [noise=true , address=193.149.164.66:4969  , piece_id=TQAEBBL3NMSXN7YUXCYLMN3KVDY7DYUN5PHQC6FRVJO3FNISMW7A, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.617983306 (104h3m22.214754335s) [noise=true , address=193.149.164.71:4307  , piece_id=6XMWPCUUFSS367ZOPXAVVNK7UEQYILMHQ25V6KWYMIHPANAD64UA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:03:24.618344030 (104h3m22.215115053s) [noise=true , address=193.149.164.68:4060  , piece_id=CV77U2FDQCXVYJTMM5YHHJM3UNS2JSNAVT3GIILX3PUTAEZCUSQQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: <nil>
Mar 10 19:04:23.953044817 (104h4m21.549815854s) [noise=true , address=77.90.31.14:4672     , piece_id=Z7T6GIQAFYDBTSFUWQDZI76BC2HAP5P4CRBL3FS6TXLIWGBOEAFA, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953336512 (104h4m21.550107545s) [noise=true , address=77.90.31.18:4812     , piece_id=P6FZQ2SMBWUPUWGCKSSBGPK36S7PTGJQD2U7TX5GQHZW57DMEFBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:128qNJJSSwMBPvN8wmTcUeMWAJxVmpjWjwA6WTKxBNCmT2FdFJn, address:77.90.31.18:4812): protocol: rpc: dial tcp 77.90.31.18:4812: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953405756 (104h4m21.550176788s) [noise=true , address=77.90.31.11:4574     , piece_id=4VKF6DIFSDAOJQYDRUD4HWWD7H52HOO5K6ECY7YJNZCJLATP3LBQ, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1pX3YNcCwaUeMstL4NNwvnKQmHbmdxLTUc8sDHwyvZGZtzmYgW, address:77.90.31.11:4574): protocol: rpc: dial tcp 77.90.31.11:4574: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953728735 (104h4m21.550499767s) [noise=true , address=77.90.31.17:4799     , piece_id=EGZJRMABIDDGXD4ENRV5GK4H5QRRU2XOKBLWFK5GKNNZB6YY4F6Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:12UhAksgXZuFGAVheaYzP7D4kwVyAjUAq3BtrvdSxszjNCFCTWT, address:77.90.31.17:4799): protocol: rpc: dial tcp 77.90.31.17:4799: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953818559 (104h4m21.550589577s) [noise=true , address=77.90.31.19:4858     , piece_id=SROVWBOSZFIRFJJ2B5RCTDYQTZFJACNDCVQYKIB67MQ465UUE62Q, seg_pos={0 0}, upload=116469]: Done uploading piece. err: ecclient: upload failed (node:1F7WDweCEEWG1kxAAQpJPcigEHsrjuqpuGhGTzNPPYTsXEX43c, address:77.90.31.19:4858): protocol: write tcp 159.223.143.39:44754->77.90.31.19:4858: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:04:23.953865997 (104h4m21.550637012s) [seg_pos={0 0}, upload=116469]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 19:04:23.975449925 (104h4m21.572220956s) [upload=116469]: Done uploading segments...
Mar 10 19:04:23.975517148 (104h4m21.572288184s) [upload=116469]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.025495775s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [..........X.................................................]
duration: 
561.093823ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:04:13 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 561.124499ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
3 out of 60 is failed (threshold=3) [...X..X................................................X....]
duration: 
2.635339635s
trace: 
https://jaeger.dev.storj.io/trace/41fc19646dedf2b
FAIL (2026-03-10 19:04:10 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
59:48.871752042 (103h59m46.468523065s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.871766366 (103h59m46.468537394s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872236431 (103h59m46.469007465s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872476023 (103h59m46.469247056s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872642319 (103h59m46.469413365s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873017409 (103h59m46.469788442s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873112445 (103h59m46.469883471s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873504435 (103h59m46.470275458s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873518754 (103h59m46.470289784s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873935290 (103h59m46.470706313s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873941072 (103h59m46.470712101s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.878089390 (103h59m46.474860423s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:49.248411606 (103h59m46.84518263s) [upload=116406]: Next returned nil segment
Mar 10 18:59:49.248425455 (103h59m46.845196479s) [upload=116406]: Waiting for error group managing segments...
Mar 10 18:59:49.474071618 (103h59m47.070842642s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.480292316 (103h59m47.07706334s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.489340334 (103h59m47.086111357s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.504000682 (103h59m47.100771706s) [noise=true , address=81.171.14.70:4025    , piece_id=D34FMTR4XLUI6HWNTNBC6ESS42BC33F4WYA4ABR2CHJJ6H5S7YIQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.532473713 (103h59m47.129244742s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.537613891 (103h59m47.134384904s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549489567 (103h59m47.146260589s) [noise=true , address=89.149.201.147:4014  , piece_id=5Q7HBKB3WLFUKAGWJ64IXNCXPAATDIFUCYN6N2V2XSDH2VWBLWJA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549783369 (103h59m47.146554395s) [noise=true , address=89.149.201.147:4010  , piece_id=WRP553BFHMTHKDA52R4B27FRRYDITSUXJMWZIQGETJQ534RXOSOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.550944998 (103h59m47.147716022s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.552358477 (103h59m47.1491295s) [noise=true , address=185.167.204.206:4066 , piece_id=LY33PR2OIW6UHZDFP453BGMG6IRJEYTTU7WD3JFPEFLQP6ERGUOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.556323257 (103h59m47.153094271s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.557938128 (103h59m47.154709158s) [noise=true , address=185.167.204.205:4030 , piece_id=FMVAQDEEBV2O4IVQDOLXUKF3DSDMDBM7J2WAHQ5LL3XIQDEXDXAA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558180752 (103h59m47.154951776s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558651610 (103h59m47.155422634s) [noise=true , address=89.149.201.147:4009  , piece_id=6DUG4IKPT57NLKPPLQYBMBHICPG65BHRZCTTIGFJZJ5253XU42BA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558678943 (103h59m47.155449966s) [noise=true , address=89.149.201.147:4023  , piece_id=2SU7S4JGCLGDYZUJAP7R7M4NNEMLHTRNLZQV2APBOGBK3WDKDYZQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.575712930 (103h59m47.172483953s) [noise=true , address=185.167.204.206:4060 , piece_id=G6JD5YY4L3BVJADVWRRKCJFBFKR7LK2XL2YSVCMFUBCRALB2G2AQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.593797789 (103h59m47.190568818s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.598510090 (103h59m47.195281116s) [noise=true , address=89.149.201.147:4012  , piece_id=OT7VVAXSBT262LDOIQPT4LGSBAGQ7ICJEVBGXM7UYUINPES5DI2A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.641662861 (103h59m47.238433876s) [noise=true , address=185.167.204.206:4054 , piece_id=OMEHHTI27QJPSX4YA6ZF4EQR22JY2XGU6FHLI65P5YNXVOQGAL3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.048638281 (103h59m47.645409304s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.109812159 (103h59m47.706583181s) [noise=true , address=185.167.204.205:4019 , piece_id=GCHTNKUHMMKWJ2QHDFLO5EHTWNWL33MXYBTM3WAWF773XBWZHX6A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:51.470994001 (103h59m49.067765025s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.215239364 (103h59m49.812010379s) [noise=true , address=185.167.204.206:4056 , piece_id=T4SSK3GQ32JLSSCBFTQGWNEB3SI6VGJBOQDIIJSBOHIVCDMEEZAQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.415825498 (103h59m50.012596522s) [noise=true , address=185.167.204.206:4063 , piece_id=NYAMWJ6LZSW5BZS3EZRO2HSOCICIEMSVLZ3FF3W764VSDDBJR7KQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:53.171677840 (103h59m50.768448864s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 19:00:48.501538387 (104h0m46.09830942s) [noise=true , address=89.149.201.147:4001  , piece_id=YLIRWGW7D6LGIDT5Q475DY7LZDSLNP5DB6UETRFQ6GZALNBQTDWQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:54340->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501665952 (104h0m46.09843697s) [noise=true , address=89.149.201.147:4007  , piece_id=ZNB53UYB4VYMTUBTT2YEOSAXDZVTEATKM5YZGQNS6SWDNFUBMQFQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33044->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501953179 (104h0m46.09872421s) [noise=true , address=89.149.201.147:4006  , piece_id=4UFBWFA5SK7BKB6EGF6HW6MSQPKKMJKXZDHW6UNDS3I6TP3TLFYA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU, address:89.149.201.147:4006): protocol: read tcp 159.223.143.39:60806->89.149.201.147:4006: use of closed network connection; context deadline exceeded
Mar 10 19:00:48.501990253 (104h0m46.09876127s) [seg_pos={0 0}, upload=116406]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 19:00:48.600564516 (104h0m46.197335537s) [upload=116406]: Done uploading segments...
Mar 10 19:00:48.600611284 (104h0m46.197382321s) [upload=116406]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.635370353s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [...........X................................................]
duration: 
532.966346ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:03:51 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 533.149717ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [............X...............................................]
duration: 
516.745281ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:03:36 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 516.839201ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [..............X..................X..........................]
duration: 
754.149807ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:03:32 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 754.173555ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.........................X.......X.............X....X.......]
duration: 
1.280992s
trace: 
https://jaeger.dev.storj.io/trace/5551066fb24b6624
FAIL (2026-03-10 19:03:30 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
 [upload=116365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 18:57:27.484826534 (103h57m25.081597557s) [upload=116365]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 18:57:27.521721468 (103h57m25.11849248s) [seg_pos={0 0}, upload=116365]: Begin upload segment...
Mar 10 18:57:27.521868020 (103h57m25.118639046s) [seg_pos={0 0}, upload=116365]: Done begin upload segment.
Mar 10 18:57:27.521902956 (103h57m25.118673979s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.521983909 (103h57m25.118754933s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.523613945 (103h57m25.120384968s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524285299 (103h57m25.121056331s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524949601 (103h57m25.121720624s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525484827 (103h57m25.12225585s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525969502 (103h57m25.122740528s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.526481271 (103h57m25.123252294s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527363350 (103h57m25.124134383s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527903397 (103h57m25.12467443s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.528459198 (103h57m25.125230242s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529239126 (103h57m25.12601015s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529855918 (103h57m25.126626944s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.530483568 (103h57m25.1272546s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531044521 (103h57m25.127815545s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531608342 (103h57m25.128379366s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532233632 (103h57m25.12900466s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532810194 (103h57m25.129581217s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.598647582 (103h57m25.195418592s) [upload=116365]: Next returned nil segment
Mar 10 18:57:27.598660671 (103h57m25.195431693s) [upload=116365]: Waiting for error group managing segments...
Mar 10 18:57:27.617260011 (103h57m25.214031035s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623564891 (103h57m25.22033592s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623817360 (103h57m25.220588374s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.624221744 (103h57m25.220992769s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.627462959 (103h57m25.224233983s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.654127655 (103h57m25.250898681s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.900823571 (103h57m25.497594593s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.063905047 (103h57m25.660676071s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.073501018 (103h57m25.670272043s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.113442671 (103h57m25.710213697s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.120035234 (103h57m25.716806258s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.191954998 (103h57m25.788726025s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:58:27.450793500 (103h58m25.047564535s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw, address:77.90.31.18:4815): protocol: rpc: dial tcp 77.90.31.18:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.450883537 (103h58m25.04765457s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh, address:77.90.31.21:4900): protocol: rpc: dial tcp 77.90.31.21:4900: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451074703 (103h58m25.047845735s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1kSxoZb9nmG6oGNytpFTsoiGh3ZPmebVVe8TZxGzANaw7EfdeF, address:77.90.31.12:4593): protocol: rpc: dial tcp 77.90.31.12:4593: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451150309 (103h58m25.047921346s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451331738 (103h58m25.048102771s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx, address:77.90.31.17:4789): protocol: context deadline exceeded; context deadline exceeded
Mar 10 18:58:27.451342106 (103h58m25.048113141s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd, address:77.90.31.16:4738): protocol: write tcp 159.223.143.39:37834->77.90.31.16:4738: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451368018 (103h58m25.048139029s) [seg_pos={0 0}, upload=116365]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 10 18:58:27.484713412 (103h58m25.08148443s) [upload=116365]: Done uploading segments...
Mar 10 18:58:27.484792918 (103h58m25.081563946s) [upload=116365]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1.28101724s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
3 out of 60 is failed (threshold=3) [....X..X................................................X...]
duration: 
2.565844447s
trace: 
https://jaeger.dev.storj.io/trace/41fc19646dedf2b
FAIL (2026-03-10 19:03:12 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
59:48.871752042 (103h59m46.468523065s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.871766366 (103h59m46.468537394s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872236431 (103h59m46.469007465s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872476023 (103h59m46.469247056s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872642319 (103h59m46.469413365s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873017409 (103h59m46.469788442s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873112445 (103h59m46.469883471s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873504435 (103h59m46.470275458s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873518754 (103h59m46.470289784s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873935290 (103h59m46.470706313s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873941072 (103h59m46.470712101s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.878089390 (103h59m46.474860423s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:49.248411606 (103h59m46.84518263s) [upload=116406]: Next returned nil segment
Mar 10 18:59:49.248425455 (103h59m46.845196479s) [upload=116406]: Waiting for error group managing segments...
Mar 10 18:59:49.474071618 (103h59m47.070842642s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.480292316 (103h59m47.07706334s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.489340334 (103h59m47.086111357s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.504000682 (103h59m47.100771706s) [noise=true , address=81.171.14.70:4025    , piece_id=D34FMTR4XLUI6HWNTNBC6ESS42BC33F4WYA4ABR2CHJJ6H5S7YIQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.532473713 (103h59m47.129244742s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.537613891 (103h59m47.134384904s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549489567 (103h59m47.146260589s) [noise=true , address=89.149.201.147:4014  , piece_id=5Q7HBKB3WLFUKAGWJ64IXNCXPAATDIFUCYN6N2V2XSDH2VWBLWJA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549783369 (103h59m47.146554395s) [noise=true , address=89.149.201.147:4010  , piece_id=WRP553BFHMTHKDA52R4B27FRRYDITSUXJMWZIQGETJQ534RXOSOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.550944998 (103h59m47.147716022s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.552358477 (103h59m47.1491295s) [noise=true , address=185.167.204.206:4066 , piece_id=LY33PR2OIW6UHZDFP453BGMG6IRJEYTTU7WD3JFPEFLQP6ERGUOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.556323257 (103h59m47.153094271s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.557938128 (103h59m47.154709158s) [noise=true , address=185.167.204.205:4030 , piece_id=FMVAQDEEBV2O4IVQDOLXUKF3DSDMDBM7J2WAHQ5LL3XIQDEXDXAA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558180752 (103h59m47.154951776s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558651610 (103h59m47.155422634s) [noise=true , address=89.149.201.147:4009  , piece_id=6DUG4IKPT57NLKPPLQYBMBHICPG65BHRZCTTIGFJZJ5253XU42BA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558678943 (103h59m47.155449966s) [noise=true , address=89.149.201.147:4023  , piece_id=2SU7S4JGCLGDYZUJAP7R7M4NNEMLHTRNLZQV2APBOGBK3WDKDYZQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.575712930 (103h59m47.172483953s) [noise=true , address=185.167.204.206:4060 , piece_id=G6JD5YY4L3BVJADVWRRKCJFBFKR7LK2XL2YSVCMFUBCRALB2G2AQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.593797789 (103h59m47.190568818s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.598510090 (103h59m47.195281116s) [noise=true , address=89.149.201.147:4012  , piece_id=OT7VVAXSBT262LDOIQPT4LGSBAGQ7ICJEVBGXM7UYUINPES5DI2A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.641662861 (103h59m47.238433876s) [noise=true , address=185.167.204.206:4054 , piece_id=OMEHHTI27QJPSX4YA6ZF4EQR22JY2XGU6FHLI65P5YNXVOQGAL3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.048638281 (103h59m47.645409304s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.109812159 (103h59m47.706583181s) [noise=true , address=185.167.204.205:4019 , piece_id=GCHTNKUHMMKWJ2QHDFLO5EHTWNWL33MXYBTM3WAWF773XBWZHX6A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:51.470994001 (103h59m49.067765025s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.215239364 (103h59m49.812010379s) [noise=true , address=185.167.204.206:4056 , piece_id=T4SSK3GQ32JLSSCBFTQGWNEB3SI6VGJBOQDIIJSBOHIVCDMEEZAQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.415825498 (103h59m50.012596522s) [noise=true , address=185.167.204.206:4063 , piece_id=NYAMWJ6LZSW5BZS3EZRO2HSOCICIEMSVLZ3FF3W764VSDDBJR7KQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:53.171677840 (103h59m50.768448864s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 19:00:48.501538387 (104h0m46.09830942s) [noise=true , address=89.149.201.147:4001  , piece_id=YLIRWGW7D6LGIDT5Q475DY7LZDSLNP5DB6UETRFQ6GZALNBQTDWQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:54340->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501665952 (104h0m46.09843697s) [noise=true , address=89.149.201.147:4007  , piece_id=ZNB53UYB4VYMTUBTT2YEOSAXDZVTEATKM5YZGQNS6SWDNFUBMQFQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33044->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501953179 (104h0m46.09872421s) [noise=true , address=89.149.201.147:4006  , piece_id=4UFBWFA5SK7BKB6EGF6HW6MSQPKKMJKXZDHW6UNDS3I6TP3TLFYA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU, address:89.149.201.147:4006): protocol: read tcp 159.223.143.39:60806->89.149.201.147:4006: use of closed network connection; context deadline exceeded
Mar 10 19:00:48.501990253 (104h0m46.09876127s) [seg_pos={0 0}, upload=116406]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 19:00:48.600564516 (104h0m46.197335537s) [upload=116406]: Done uploading segments...
Mar 10 19:00:48.600611284 (104h0m46.197382321s) [upload=116406]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.565868835s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [................................X...X...X...................]
duration: 
1.314254951s
trace: 
https://jaeger.dev.storj.io/trace/3e3462f802bd0715
FAIL (2026-03-10 19:02:50 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 10 18:47:13.131133705 (103h47m10.727904738s) [upload=116175]: Starting upload
Mar 10 18:47:13.131204716 (103h47m10.727975809s) [upload=116175]: Done starting upload
Mar 10 18:47:13.131321599 (103h47m10.728092622s) [upload=116175]: Uploading segments...
Mar 10 18:47:13.131498028 (103h47m10.728269042s) [upload=116175]: Got next segment. Inline: false
Mar 10 18:47:13.131549439 (103h47m10.728320462s) [upload=116175]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 18:47:13.131554753 (103h47m10.728325776s) [upload=116175]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 18:47:13.160082729 (103h47m10.756853751s) [seg_pos={0 0}, upload=116175]: Begin upload segment...
Mar 10 18:47:13.160171054 (103h47m10.756942077s) [seg_pos={0 0}, upload=116175]: Done begin upload segment.
Mar 10 18:47:13.160224126 (103h47m10.756995155s) [noise=true , address=145.79.227.32:4864   , piece_id=YC4R53EAKWE2HEA2X6KREQHAQQOYF2FL3MFRVX3P6V4EFMTNKNIQ, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.160287959 (103h47m10.757058982s) [noise=true , address=77.90.31.11:4561     , piece_id=GKD3QOLFWMUQJ2BWSEZCRIP3SIWK5CGR2OCSD7UG5L4ZMPDQW72Q, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.162019643 (103h47m10.758790678s) [noise=true , address=45.91.116.14:4206    , piece_id=PAGENFX3BMPNE2RQJ7XVCYOCN46Z7K6K6A637XVXWMCLBGSTSVNQ, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.162608353 (103h47m10.759379382s) [noise=true , address=193.149.164.67:4012  , piece_id=W65G5XNHKFPGIDZHC3X77YIK5O4Q4JTDCVHBAFGWADUJB6JUKLCA, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.163142708 (103h47m10.759913732s) [noise=true , address=193.149.164.66:4983  , piece_id=VRXG4YE6RIAZTGIFVRC6EPDUC4I5MTVM6BL35QWGNNZUZ4FBE7MA, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.163503887 (103h47m10.76027492s) [noise=true , address=167.17.72.68:4672    , piece_id=CB2TS4GC6MCT6T3VVVUYDBRAFJDNER6CIDMQI3BQKNBL24K6SMUA, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.163575954 (103h47m10.760346993s) [noise=true , address=79.127.219.45:4865   , piece_id=DNT2XJ27EN7OYU3OSGUVLBGV2XLOC3WGEFRFE24YM7RUVWB3THDA, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.164036842 (103h47m10.760807865s) [noise=true , address=193.149.164.69:4104  , piece_id=OL5YHMN4A5Y4EIVSSKQO25RFRT34D5HSQUMYKVUWJF6DMYCVX75A, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.164118967 (103h47m10.760889993s) [noise=true , address=77.90.31.16:4754     , piece_id=YCVLN5EESISHEV7UN5UQHUNMLCY2A5WETSXZY3XNH7KFO4UNNODA, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.164530812 (103h47m10.761301839s) [noise=true , address=193.149.164.68:4042  , piece_id=34FVVBDNY3OLD6LJ4PRUQJVK6L6DUMX4BROI7UNTSBYX7CHDOD6Q, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.164752563 (103h47m10.7615236s) [noise=true , address=145.79.227.5:4233    , piece_id=QF5NXVRZRMEIYCVOLABF4K5RLAF6AQDYPKGGZEXXQ2XKD7HAE6KQ, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.165002038 (103h47m10.761773061s) [noise=true , address=145.79.227.11:4746   , piece_id=IPQHMFB7TI6QBYRKBD5QSILG5MSVISYIOHI46Q4XFPIVGXEMFMYQ, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.165326057 (103h47m10.762097084s) [noise=true , address=77.90.31.17:4776     , piece_id=L46MHS6SXUAWGVHTAORD6XEUZK2HNAADS2EFKVO6KZD52VUFVQUQ, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.165449546 (103h47m10.762220572s) [noise=true , address=167.17.72.71:4790    , piece_id=NDFWQKJZ5E7IIQBD4QAHIFLQSMB2NDOHNIU5WLZSVGZSHX3VDWMA, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.165846479 (103h47m10.762617503s) [noise=true , address=77.90.31.12:4603     , piece_id=7EZO6VVXZYB2AFXLDNAGZBOE3Q2PQX57TJBUVXXQ64ZMSQ6T2JQA, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.165877733 (103h47m10.762648758s) [noise=true , address=79.127.219.38:4834   , piece_id=HRCTROMY5HCARHYNQHL6UFW7D667ZAFPHH5HKQWIEU4F26VIEE3Q, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.166348308 (103h47m10.763119334s) [noise=true , address=77.90.31.15:4702     , piece_id=KIPCIMVO4G6CCAOBC5RDGOHNWF2JEJFTLGPDSDDOJ6RQURTZZNEA, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.166840248 (103h47m10.763611272s) [noise=true , address=193.149.164.71:4318  , piece_id=7WDE5OROP62BN2PYRJSW5QACWOZGHS6H3JSWV4YGK3UMISRIRAMA, seg_pos={0 0}, upload=116175]: Uploading piece...
Mar 10 18:47:13.235318918 (103h47m10.832089941s) [upload=116175]: Next returned nil segment
Mar 10 18:47:13.235332456 (103h47m10.832103479s) [upload=116175]: Waiting for error group managing segments...
Mar 10 18:47:13.241482194 (103h47m10.838253208s) [noise=true , address=145.79.227.11:4746   , piece_id=IPQHMFB7TI6QBYRKBD5QSILG5MSVISYIOHI46Q4XFPIVGXEMFMYQ, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.241608016 (103h47m10.838379046s) [noise=true , address=79.127.219.45:4865   , piece_id=DNT2XJ27EN7OYU3OSGUVLBGV2XLOC3WGEFRFE24YM7RUVWB3THDA, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.242020069 (103h47m10.838791092s) [noise=true , address=145.79.227.5:4233    , piece_id=QF5NXVRZRMEIYCVOLABF4K5RLAF6AQDYPKGGZEXXQ2XKD7HAE6KQ, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.242080152 (103h47m10.838851175s) [noise=true , address=79.127.219.38:4834   , piece_id=HRCTROMY5HCARHYNQHL6UFW7D667ZAFPHH5HKQWIEU4F26VIEE3Q, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.256022458 (103h47m10.852793481s) [noise=true , address=45.91.116.14:4206    , piece_id=PAGENFX3BMPNE2RQJ7XVCYOCN46Z7K6K6A637XVXWMCLBGSTSVNQ, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.301466089 (103h47m10.898237119s) [noise=true , address=145.79.227.32:4864   , piece_id=YC4R53EAKWE2HEA2X6KREQHAQQOYF2FL3MFRVX3P6V4EFMTNKNIQ, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.516165507 (103h47m11.112936531s) [noise=true , address=167.17.72.68:4672    , piece_id=CB2TS4GC6MCT6T3VVVUYDBRAFJDNER6CIDMQI3BQKNBL24K6SMUA, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.539446055 (103h47m11.136217082s) [noise=true , address=167.17.72.71:4790    , piece_id=NDFWQKJZ5E7IIQBD4QAHIFLQSMB2NDOHNIU5WLZSVGZSHX3VDWMA, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.738358444 (103h47m11.335129472s) [noise=true , address=193.149.164.67:4012  , piece_id=W65G5XNHKFPGIDZHC3X77YIK5O4Q4JTDCVHBAFGWADUJB6JUKLCA, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.752473842 (103h47m11.349244865s) [noise=true , address=193.149.164.69:4104  , piece_id=OL5YHMN4A5Y4EIVSSKQO25RFRT34D5HSQUMYKVUWJF6DMYCVX75A, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.763441174 (103h47m11.360212197s) [noise=true , address=193.149.164.68:4042  , piece_id=34FVVBDNY3OLD6LJ4PRUQJVK6L6DUMX4BROI7UNTSBYX7CHDOD6Q, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.764387111 (103h47m11.36115814s) [noise=true , address=193.149.164.71:4318  , piece_id=7WDE5OROP62BN2PYRJSW5QACWOZGHS6H3JSWV4YGK3UMISRIRAMA, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:47:13.771769055 (103h47m11.368540082s) [noise=true , address=193.149.164.66:4983  , piece_id=VRXG4YE6RIAZTGIFVRC6EPDUC4I5MTVM6BL35QWGNNZUZ4FBE7MA, seg_pos={0 0}, upload=116175]: Done uploading piece. err: <nil>
Mar 10 18:48:13.100100612 (103h48m10.69687164s) [noise=true , address=77.90.31.16:4754     , piece_id=YCVLN5EESISHEV7UN5UQHUNMLCY2A5WETSXZY3XNH7KFO4UNNODA, seg_pos={0 0}, upload=116175]: Done uploading piece. err: ecclient: upload failed (node:12KKCnEfLWFbLY7ViZ8uzgKfNDeVby4XaoRiBKiQCH39mq82RJ8, address:77.90.31.16:4754): protocol: rpc: dial tcp 77.90.31.16:4754: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:48:13.100324844 (103h48m10.697095871s) [noise=true , address=77.90.31.17:4776     , piece_id=L46MHS6SXUAWGVHTAORD6XEUZK2HNAADS2EFKVO6KZD52VUFVQUQ, seg_pos={0 0}, upload=116175]: Done uploading piece. err: ecclient: upload failed (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ, address:77.90.31.17:4776): protocol: write tcp 159.223.143.39:39454->77.90.31.17:4776: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:48:13.100416404 (103h48m10.697187432s) [noise=true , address=77.90.31.12:4603     , piece_id=7EZO6VVXZYB2AFXLDNAGZBOE3Q2PQX57TJBUVXXQ64ZMSQ6T2JQA, seg_pos={0 0}, upload=116175]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:48:13.100713166 (103h48m10.697484193s) [noise=true , address=77.90.31.11:4561     , piece_id=GKD3QOLFWMUQJ2BWSEZCRIP3SIWK5CGR2OCSD7UG5L4ZMPDQW72Q, seg_pos={0 0}, upload=116175]: Done uploading piece. err: ecclient: upload failed (node:12bkhuJ5T8SgGFMn6vv6wWnHiJarcMgVuhk6JNmNZoskzwP1gVi, address:77.90.31.11:4561): protocol: write tcp 159.223.143.39:35880->77.90.31.11:4561: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:48:13.100860410 (103h48m10.697631433s) [noise=true , address=77.90.31.15:4702     , piece_id=KIPCIMVO4G6CCAOBC5RDGOHNWF2JEJFTLGPDSDDOJ6RQURTZZNEA, seg_pos={0 0}, upload=116175]: Done uploading piece. err: ecclient: upload failed (node:1ucSAZVBqRRJU7WZDKs7Cs6yKV73haX7px76sfukA6b8Q8DDsW, address:77.90.31.15:4702): protocol: write tcp 159.223.143.39:33634->77.90.31.15:4702: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:48:13.100893545 (103h48m10.697664561s) [seg_pos={0 0}, upload=116175]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 10 18:48:13.129150766 (103h48m10.725921853s) [upload=116175]: Done uploading segments...
Mar 10 18:48:13.129195755 (103h48m10.725966784s) [upload=116175]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.314282664s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [..........................X.......X.............X....X......]
duration: 
1.289016685s
trace: 
https://jaeger.dev.storj.io/trace/5551066fb24b6624
FAIL (2026-03-10 19:02:42 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
 [upload=116365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 18:57:27.484826534 (103h57m25.081597557s) [upload=116365]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 18:57:27.521721468 (103h57m25.11849248s) [seg_pos={0 0}, upload=116365]: Begin upload segment...
Mar 10 18:57:27.521868020 (103h57m25.118639046s) [seg_pos={0 0}, upload=116365]: Done begin upload segment.
Mar 10 18:57:27.521902956 (103h57m25.118673979s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.521983909 (103h57m25.118754933s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.523613945 (103h57m25.120384968s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524285299 (103h57m25.121056331s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524949601 (103h57m25.121720624s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525484827 (103h57m25.12225585s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525969502 (103h57m25.122740528s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.526481271 (103h57m25.123252294s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527363350 (103h57m25.124134383s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527903397 (103h57m25.12467443s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.528459198 (103h57m25.125230242s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529239126 (103h57m25.12601015s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529855918 (103h57m25.126626944s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.530483568 (103h57m25.1272546s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531044521 (103h57m25.127815545s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531608342 (103h57m25.128379366s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532233632 (103h57m25.12900466s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532810194 (103h57m25.129581217s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.598647582 (103h57m25.195418592s) [upload=116365]: Next returned nil segment
Mar 10 18:57:27.598660671 (103h57m25.195431693s) [upload=116365]: Waiting for error group managing segments...
Mar 10 18:57:27.617260011 (103h57m25.214031035s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623564891 (103h57m25.22033592s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623817360 (103h57m25.220588374s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.624221744 (103h57m25.220992769s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.627462959 (103h57m25.224233983s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.654127655 (103h57m25.250898681s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.900823571 (103h57m25.497594593s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.063905047 (103h57m25.660676071s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.073501018 (103h57m25.670272043s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.113442671 (103h57m25.710213697s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.120035234 (103h57m25.716806258s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.191954998 (103h57m25.788726025s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:58:27.450793500 (103h58m25.047564535s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw, address:77.90.31.18:4815): protocol: rpc: dial tcp 77.90.31.18:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.450883537 (103h58m25.04765457s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh, address:77.90.31.21:4900): protocol: rpc: dial tcp 77.90.31.21:4900: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451074703 (103h58m25.047845735s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1kSxoZb9nmG6oGNytpFTsoiGh3ZPmebVVe8TZxGzANaw7EfdeF, address:77.90.31.12:4593): protocol: rpc: dial tcp 77.90.31.12:4593: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451150309 (103h58m25.047921346s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451331738 (103h58m25.048102771s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx, address:77.90.31.17:4789): protocol: context deadline exceeded; context deadline exceeded
Mar 10 18:58:27.451342106 (103h58m25.048113141s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd, address:77.90.31.16:4738): protocol: write tcp 159.223.143.39:37834->77.90.31.16:4738: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451368018 (103h58m25.048139029s) [seg_pos={0 0}, upload=116365]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 10 18:58:27.484713412 (103h58m25.08148443s) [upload=116365]: Done uploading segments...
Mar 10 18:58:27.484792918 (103h58m25.081563946s) [upload=116365]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1.289044266s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [.............X..............................................]
duration: 
902.235892ms
trace: 
https://jaeger.dev.storj.io/trace/33e9eb6cbded500c
FAIL (2026-03-10 19:02:40 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 902.26391ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [...............X..................X.........................]
duration: 
740.450542ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:02:39 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 740.611264ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [................X..................X........................]
duration: 
955.513783ms
trace: 
https://jaeger.dev.storj.io/trace/66877fbb536219fd
FAIL (2026-03-10 19:02:21 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 955.541385ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [...........................X.......X.............X....X.....]
duration: 
1.466560554s
trace: 
https://jaeger.dev.storj.io/trace/5551066fb24b6624
FAIL (2026-03-10 19:02:05 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
 [upload=116365]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 10 18:57:27.484826534 (103h57m25.081597557s) [upload=116365]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 10 18:57:27.521721468 (103h57m25.11849248s) [seg_pos={0 0}, upload=116365]: Begin upload segment...
Mar 10 18:57:27.521868020 (103h57m25.118639046s) [seg_pos={0 0}, upload=116365]: Done begin upload segment.
Mar 10 18:57:27.521902956 (103h57m25.118673979s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.521983909 (103h57m25.118754933s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.523613945 (103h57m25.120384968s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524285299 (103h57m25.121056331s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.524949601 (103h57m25.121720624s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525484827 (103h57m25.12225585s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.525969502 (103h57m25.122740528s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.526481271 (103h57m25.123252294s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527363350 (103h57m25.124134383s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.527903397 (103h57m25.12467443s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.528459198 (103h57m25.125230242s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529239126 (103h57m25.12601015s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.529855918 (103h57m25.126626944s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.530483568 (103h57m25.1272546s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531044521 (103h57m25.127815545s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.531608342 (103h57m25.128379366s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532233632 (103h57m25.12900466s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.532810194 (103h57m25.129581217s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Uploading piece...
Mar 10 18:57:27.598647582 (103h57m25.195418592s) [upload=116365]: Next returned nil segment
Mar 10 18:57:27.598660671 (103h57m25.195431693s) [upload=116365]: Waiting for error group managing segments...
Mar 10 18:57:27.617260011 (103h57m25.214031035s) [noise=true , address=145.79.227.45:4254   , piece_id=UZTZ6H7VQNI7MMVFL5FBST5SLNZQ47XED2RNRB6LKU4LJC7BXWVQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623564891 (103h57m25.22033592s) [noise=true , address=45.91.116.10:4099    , piece_id=NBH2YPXPI3GOPWD32DEUKZPDZ5PENXITZT35UOMX3RLKRWBLJ6TQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.623817360 (103h57m25.220588374s) [noise=true , address=45.91.116.4:4943     , piece_id=QKAVY6T6E5BHQRKTKILCXZUA6LQIVFAZ7DMH7JFH6EEB73SFGN6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.624221744 (103h57m25.220992769s) [noise=true , address=45.91.116.9:4291     , piece_id=3YK352DQH7PT2HCSMBHPIGBQIFXWIXNDE5FX7H2TNZ5334O5D6HQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.627462959 (103h57m25.224233983s) [noise=true , address=145.79.227.33:4890   , piece_id=OW4CDCUND735Q3O55EF4PX4M4TKSIOEWI67PHLISO6QIK6OPHJSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.654127655 (103h57m25.250898681s) [noise=true , address=79.127.219.45:4873   , piece_id=M7FKYFT2QI5ZLRXAZGWJGRFFGIQR6BIXLA4SEZ2D6CF63Z5IYWUQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:27.900823571 (103h57m25.497594593s) [noise=true , address=167.17.72.70:4777    , piece_id=ZPCWKHJR7NYCNNIGCJSLAVXV644MEM5HQY7CWNXWISQJVKLWYNQA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.063905047 (103h57m25.660676071s) [noise=true , address=79.127.205.235:4279  , piece_id=PBNOSAQFGLCKAXXMYUXB4WJADRAVQOHLA53LJO3UHPUA6D3JXU2Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.073501018 (103h57m25.670272043s) [noise=true , address=79.127.205.234:4179  , piece_id=IN4T2HFA4F27KSXVUHO46XZP6K2RHG3YHBBRGTEOCSSQO4DRSWWQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.113442671 (103h57m25.710213697s) [noise=true , address=193.149.164.69:4099  , piece_id=QZFRYTG5ECLVDGGXROBGNXW5SWDERMEOG6YVX62CPMTR3U735O6Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.120035234 (103h57m25.716806258s) [noise=true , address=64.49.13.140:4511    , piece_id=N3JWQXVVCAWUKCYWZ54MA4FM34IORGL436WI37JWPOF7VOMDGM6A, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:57:28.191954998 (103h57m25.788726025s) [noise=true , address=64.49.13.27:4967     , piece_id=PSJ3MO3TEICL6QCFKPXGOQDLGTP7C6YJPQZNCSKJKCIN32YZPZOA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: <nil>
Mar 10 18:58:27.450793500 (103h58m25.047564535s) [noise=true , address=77.90.31.18:4815     , piece_id=DZW2JJC3WP52JUX7PQN2GRLNGAGX5ABNYNHLZOR7C2P23CBA3B4Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw, address:77.90.31.18:4815): protocol: rpc: dial tcp 77.90.31.18:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.450883537 (103h58m25.04765457s) [noise=true , address=77.90.31.21:4900     , piece_id=J3FUPH6SIWIPZUBNEKGJFLP6LY6ICQK6RJJYLMXH2DCNQCTHZWSQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:129YE2Wd6LmDABJFaGVtYDwCHmStVDnPRCagD2cKPWA5PDTtZyh, address:77.90.31.21:4900): protocol: rpc: dial tcp 77.90.31.21:4900: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451074703 (103h58m25.047845735s) [noise=true , address=77.90.31.12:4593     , piece_id=M64FQFLGQBYYR4SSZT2OHQIQJ342GOLLPFNIZCPKVPMWMWR2I3DA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1kSxoZb9nmG6oGNytpFTsoiGh3ZPmebVVe8TZxGzANaw7EfdeF, address:77.90.31.12:4593): protocol: rpc: dial tcp 77.90.31.12:4593: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451150309 (103h58m25.047921346s) [noise=true , address=77.90.31.14:4672     , piece_id=UVBCM32Q2OEPKIS2UITNSBTIV4LXYHFN4KNYXTT6IQJFNPLT4QAQ, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1jvNGA554FNdsMYESMmDnnsLmpteXcPbuiEPAZgMnngTgBNerx, address:77.90.31.14:4672): protocol: rpc: dial tcp 77.90.31.14:4672: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451331738 (103h58m25.048102771s) [noise=true , address=77.90.31.17:4789     , piece_id=4JYWDROUCOW7ABFSN524QYE5V5TU6TIUOJP6FFRSPPPVZLHTHH3Q, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx, address:77.90.31.17:4789): protocol: context deadline exceeded; context deadline exceeded
Mar 10 18:58:27.451342106 (103h58m25.048113141s) [noise=true , address=77.90.31.16:4738     , piece_id=LOIFPP7RKUQSJLSCD54RKTQCRLW7GW2BRY2IPZYNF7WFXI6VIZUA, seg_pos={0 0}, upload=116365]: Done uploading piece. err: ecclient: upload failed (node:12ZGynTzsrzGcGzMCqbeMJkxWwhYtPc2piotu6dhkJzrr4FnXKd, address:77.90.31.16:4738): protocol: write tcp 159.223.143.39:37834->77.90.31.16:4738: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 18:58:27.451368018 (103h58m25.048139029s) [seg_pos={0 0}, upload=116365]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 10 18:58:27.484713412 (103h58m25.08148443s) [upload=116365]: Done uploading segments...
Mar 10 18:58:27.484792918 (103h58m25.081563946s) [upload=116365]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1.466619095s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)
antiblip: 
3 out of 60 is failed (threshold=3) [.....X..X................................................X..]
duration: 
2.922793404s
trace: 
https://jaeger.dev.storj.io/trace/41fc19646dedf2b
FAIL (2026-03-10 19:02:05 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 25)
======LOGS======
59:48.871752042 (103h59m46.468523065s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.871766366 (103h59m46.468537394s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872236431 (103h59m46.469007465s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872476023 (103h59m46.469247056s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.872642319 (103h59m46.469413365s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873017409 (103h59m46.469788442s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873112445 (103h59m46.469883471s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873504435 (103h59m46.470275458s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873518754 (103h59m46.470289784s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873935290 (103h59m46.470706313s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.873941072 (103h59m46.470712101s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:48.878089390 (103h59m46.474860423s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Uploading piece...
Mar 10 18:59:49.248411606 (103h59m46.84518263s) [upload=116406]: Next returned nil segment
Mar 10 18:59:49.248425455 (103h59m46.845196479s) [upload=116406]: Waiting for error group managing segments...
Mar 10 18:59:49.474071618 (103h59m47.070842642s) [noise=true , address=81.171.14.70:4039    , piece_id=2CMRZ7PXFO4KRMGGWDGL5WMM3DZDS5CRMN4J52UIRJQ2U3ADY2XA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.480292316 (103h59m47.07706334s) [noise=true , address=81.171.14.70:4028    , piece_id=2IBQ6E43VW2EHJNXLYPBQNRPSUVLHCHBI3QDSXUDGYCWPVYK4Q3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.489340334 (103h59m47.086111357s) [noise=true , address=81.171.14.70:4027    , piece_id=GAHTAO4BV2ZLDTVQWFRIUBFU62JHRJKDQUZRYMZ5PVHBKC2H7TUQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.504000682 (103h59m47.100771706s) [noise=true , address=81.171.14.70:4025    , piece_id=D34FMTR4XLUI6HWNTNBC6ESS42BC33F4WYA4ABR2CHJJ6H5S7YIQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.532473713 (103h59m47.129244742s) [noise=true , address=89.149.201.147:4019  , piece_id=LX4563HAFDFGRKQRAHMUQW73C53H6IPUGSTIIYZZHCGVI5BOGM7Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.537613891 (103h59m47.134384904s) [noise=true , address=89.149.201.147:4011  , piece_id=MHGBZPAZHHTNFWDX4WJNLIWEBEZODIK3EHP6AOKMCC7XUI2DF4MQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549489567 (103h59m47.146260589s) [noise=true , address=89.149.201.147:4014  , piece_id=5Q7HBKB3WLFUKAGWJ64IXNCXPAATDIFUCYN6N2V2XSDH2VWBLWJA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.549783369 (103h59m47.146554395s) [noise=true , address=89.149.201.147:4010  , piece_id=WRP553BFHMTHKDA52R4B27FRRYDITSUXJMWZIQGETJQ534RXOSOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.550944998 (103h59m47.147716022s) [noise=true , address=81.171.14.70:4041    , piece_id=X3ZIMMXALIAS344XK4AVU3JUTIOX6ALV3H37ME5D4YUXQSJFC72Q, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.552358477 (103h59m47.1491295s) [noise=true , address=185.167.204.206:4066 , piece_id=LY33PR2OIW6UHZDFP453BGMG6IRJEYTTU7WD3JFPEFLQP6ERGUOA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.556323257 (103h59m47.153094271s) [noise=true , address=185.167.204.206:4061 , piece_id=TR7JQ2VQNGAB7XPT74UJ73NKL34GFLCUNEQLSX23PN2HUSIATCRQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.557938128 (103h59m47.154709158s) [noise=true , address=185.167.204.205:4030 , piece_id=FMVAQDEEBV2O4IVQDOLXUKF3DSDMDBM7J2WAHQ5LL3XIQDEXDXAA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558180752 (103h59m47.154951776s) [noise=true , address=185.167.204.205:4005 , piece_id=S3OUWBUADHJFP2IESZATQF66EUIKRNXTLKGYPWNELN6FPQY7AEDA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558651610 (103h59m47.155422634s) [noise=true , address=89.149.201.147:4009  , piece_id=6DUG4IKPT57NLKPPLQYBMBHICPG65BHRZCTTIGFJZJ5253XU42BA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.558678943 (103h59m47.155449966s) [noise=true , address=89.149.201.147:4023  , piece_id=2SU7S4JGCLGDYZUJAP7R7M4NNEMLHTRNLZQV2APBOGBK3WDKDYZQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.575712930 (103h59m47.172483953s) [noise=true , address=185.167.204.206:4060 , piece_id=G6JD5YY4L3BVJADVWRRKCJFBFKR7LK2XL2YSVCMFUBCRALB2G2AQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.593797789 (103h59m47.190568818s) [noise=true , address=185.167.204.206:4049 , piece_id=YTITX2QWUAY5V6QPOJM2K2BSG72DI2I7TA7QUMCFGC2OVRSM6TBQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.598510090 (103h59m47.195281116s) [noise=true , address=89.149.201.147:4012  , piece_id=OT7VVAXSBT262LDOIQPT4LGSBAGQ7ICJEVBGXM7UYUINPES5DI2A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:49.641662861 (103h59m47.238433876s) [noise=true , address=185.167.204.206:4054 , piece_id=OMEHHTI27QJPSX4YA6ZF4EQR22JY2XGU6FHLI65P5YNXVOQGAL3A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.048638281 (103h59m47.645409304s) [noise=true , address=89.149.201.147:4003  , piece_id=AY3EGMTSG27LE5UPTJDEU2U2LIZP2KGHKWEPEPIWRSROK6N3IPWA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:50.109812159 (103h59m47.706583181s) [noise=true , address=185.167.204.205:4019 , piece_id=GCHTNKUHMMKWJ2QHDFLO5EHTWNWL33MXYBTM3WAWF773XBWZHX6A, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:51.470994001 (103h59m49.067765025s) [noise=true , address=185.167.204.205:4028 , piece_id=XLWWPIGHAJRGX5IHVEFKCOU2FTEBPNIJHJG5VB7ZWTA4MV6NGESA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.215239364 (103h59m49.812010379s) [noise=true , address=185.167.204.206:4056 , piece_id=T4SSK3GQ32JLSSCBFTQGWNEB3SI6VGJBOQDIIJSBOHIVCDMEEZAQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:52.415825498 (103h59m50.012596522s) [noise=true , address=185.167.204.206:4063 , piece_id=NYAMWJ6LZSW5BZS3EZRO2HSOCICIEMSVLZ3FF3W764VSDDBJR7KQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 18:59:53.171677840 (103h59m50.768448864s) [noise=true , address=185.167.204.206:4053 , piece_id=PA33DAERI5CQ3D5OFWQDMCINLDXZKS4CEIUT22APHR4ZWYSNW7UA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: <nil>
Mar 10 19:00:48.501538387 (104h0m46.09830942s) [noise=true , address=89.149.201.147:4001  , piece_id=YLIRWGW7D6LGIDT5Q475DY7LZDSLNP5DB6UETRFQ6GZALNBQTDWQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1sNB8ZUfm8aR6jWBvWvVx6w7zZgGvbw4kuUCqMHipRWmU8o5R8, address:89.149.201.147:4001): protocol: read tcp 159.223.143.39:54340->89.149.201.147:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501665952 (104h0m46.09843697s) [noise=true , address=89.149.201.147:4007  , piece_id=ZNB53UYB4VYMTUBTT2YEOSAXDZVTEATKM5YZGQNS6SWDNFUBMQFQ, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:1Q7d4vj1KoWhDr6xd9gEfFrZ1sV3Yro2AFke2f3Ke1rXsGnvew, address:89.149.201.147:4007): protocol: read tcp 159.223.143.39:33044->89.149.201.147:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 10 19:00:48.501953179 (104h0m46.09872421s) [noise=true , address=89.149.201.147:4006  , piece_id=4UFBWFA5SK7BKB6EGF6HW6MSQPKKMJKXZDHW6UNDS3I6TP3TLFYA, seg_pos={0 0}, upload=116406]: Done uploading piece. err: ecclient: upload failed (node:12YTf9jvAKd4gVTxTZC6gGLdXC17ygbrqvqoKtmPbtHyc65YjDU, address:89.149.201.147:4006): protocol: read tcp 159.223.143.39:60806->89.149.201.147:4006: use of closed network connection; context deadline exceeded
Mar 10 19:00:48.501990253 (104h0m46.09876127s) [seg_pos={0 0}, upload=116406]: Done waiting for segment. successful: 25 optimal: 26 errs: <nil>
Mar 10 19:00:48.600564516 (104h0m46.197335537s) [upload=116406]: Done uploading segments...
Mar 10 19:00:48.600611284 (104h0m46.197382321s) [upload=116406]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 25)
Duration: 2.92282182s core uplink eu-select-1 eu1-placement-15