Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 319645 reports (Page 298 of 6393)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [.....................................XXX..........X...X.....]
duration: 
19.543771518s
trace: 
https://jaeger.dev.storj.io/trace/6a01088813e3d8b7
FAIL (2026-03-18 19:53:39 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
m: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:08.138517471 (296h49m5.735288494s) [upload=332459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:16.284286759 (296h49m13.881057773s) [seg_pos={0 0}, upload=332459]: Begin upload segment...
Mar 18 19:49:16.284352223 (296h49m13.88112325s) [seg_pos={0 0}, upload=332459]: Done begin upload segment.
Mar 18 19:49:16.284395789 (296h49m13.881166818s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284449689 (296h49m13.881220728s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284549974 (296h49m13.881320988s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285144837 (296h49m13.88191587s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285821284 (296h49m13.882592317s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.286556627 (296h49m13.883327669s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287228779 (296h49m13.883999813s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287269957 (296h49m13.884040985s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287437026 (296h49m13.884208049s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287832890 (296h49m13.884603914s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287952922 (296h49m13.884723957s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288418812 (296h49m13.885189842s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288922438 (296h49m13.885693461s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289343580 (296h49m13.886114604s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289780590 (296h49m13.88655162s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.290237004 (296h49m13.887008027s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.292879809 (296h49m13.889650843s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.293664670 (296h49m13.890435693s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.351440712 (296h49m13.948211724s) [upload=332459]: Next returned nil segment
Mar 18 19:49:16.351460639 (296h49m13.948231661s) [upload=332459]: Waiting for error group managing segments...
Mar 18 19:49:16.355941640 (296h49m13.952712664s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.356991929 (296h49m13.953762955s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.361809763 (296h49m13.958580786s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.367502365 (296h49m13.964273396s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.381549888 (296h49m13.97832091s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.387503503 (296h49m13.984274527s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.498139242 (296h49m14.094910266s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.852944491 (296h49m14.449715518s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.878068834 (296h49m14.474839867s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.892446253 (296h49m14.489217282s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.893099142 (296h49m14.48987017s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:17.031110208 (296h49m14.627881232s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:50:08.096628364 (296h50m5.693399398s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw, address:145.79.227.52:4451): protocol: rpc: dial tcp 145.79.227.52:4451: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096712565 (296h50m5.693483599s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:129LRnDm7b4Fo5db7pto8GXYEtxHz9qdPAtQvaYH6gqdkMatQ6g, address:145.79.227.44:4213): protocol: rpc: dial tcp 145.79.227.44:4213: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096943717 (296h50m5.693714752s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1, address:145.79.227.49:4358): protocol: rpc: dial tcp 145.79.227.49:4358: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097022451 (296h50m5.693793484s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12w88UkGu5duYivJ6L6C9iJmTbnB63fDKiUUQprhwM3JshpXTdC, address:145.79.227.3:4163): protocol: rpc: dial tcp 145.79.227.3:4163: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097155433 (296h50m5.693926468s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75, address:145.79.227.13:4822): protocol: rpc: dial tcp 145.79.227.13:4822: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097360007 (296h50m5.694131039s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1pfQ5v1GwHhFTvh5Y7Jpb9qpWhZhFYqWX9PJpLEUzTkqKWcy4x, address:145.79.227.15:4908): protocol: rpc: dial tcp 145.79.227.15:4908: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097462766 (296h50m5.69423378s) [seg_pos={0 0}, upload=332459]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 18 19:50:08.117913456 (296h50m5.714684468s) [upload=332459]: Done uploading segments...
Mar 18 19:50:08.117999321 (296h50m5.714770348s) [upload=332459]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 19.543804228s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
30 out of 60 is failed (threshold=6) [..........................XXXXXXXXX.XXX...XXXXXXXXXXXXXXXXXX]
duration: 
5.001720647s
trace: 
https://jaeger.dev.storj.io/trace/7ecafa59586b95fd
FAIL (2026-03-18 19:53:24 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001744831s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
24 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXXXXXXXXX]
duration: 
30.030457228s
trace: 
https://jaeger.dev.storj.io/trace/793c8f707c42053d
FAIL (2026-03-18 19:53:16 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
97217 (296h52m44.198968239s) [upload=332523]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:52:50.685984409 (296h52m48.282755446s) [seg_pos={0 0}, upload=332523]: Begin upload segment...
Mar 18 19:52:50.686052370 (296h52m48.282823403s) [seg_pos={0 0}, upload=332523]: Done begin upload segment.
Mar 18 19:52:50.686094388 (296h52m48.282865424s) [noise=true , address=145.79.227.23:4551   , piece_id=OIJSN73HORIFMDHQNZJSD7GJY6R4TC3DUUICIJMDHNHR4QADPWJA, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.686141795 (296h52m48.282912827s) [noise=true , address=145.79.227.10:4405   , piece_id=SKCT3FGRCXW7QHNZRKBCEYAATJ22QJA4A235434GB5SK6RTPCQYQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.686780983 (296h52m48.283552015s) [noise=true , address=145.79.227.34:4905   , piece_id=SSSDFRJONSSMGDYZANLIKTHQ6HBWT6IFYJDAJSSYIHE5TASNFRGQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.687586861 (296h52m48.284357895s) [noise=true , address=145.79.227.51:4409   , piece_id=76FS44U7FERWPRO72CQ3EIGPN6RQI4QOCRJH4IQ4M57EPWXBQW2Q, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.688171226 (296h52m48.284942253s) [noise=true , address=145.79.227.22:4512   , piece_id=ES4PBUL6SUOZQ26TOHVGLWOWEQVNUSPXCJPDRMEA6TXPJ2RKIPIQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.688733304 (296h52m48.285504335s) [noise=true , address=145.79.227.35:4486   , piece_id=KSSOZCWN5K7QLOGR7ZWQC4MQ5XXPOWTRTMDNJ5TSPL5L7HFIV5JA, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.689899106 (296h52m48.286670143s) [noise=true , address=77.90.31.17:4769     , piece_id=3AOOY4K55WRDB76UWX77SASXANARF7PRVZ3O22SLPWV254FDD3GQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.690441439 (296h52m48.287212471s) [noise=true , address=145.79.227.2:4119    , piece_id=INNE55CDRSMDRPWIQ4P53X7J2YUICGJ5QKQ7MAWC5WFXI2226GNA, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.690726022 (296h52m48.287497061s) [noise=true , address=77.90.31.18:4805     , piece_id=EXNTVDMKW2PALZMLLUXRUNZYE5BHTHTQVPJUSTJ367HDAI45E3MQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.692044654 (296h52m48.288815793s) [noise=true , address=145.79.227.49:4337   , piece_id=NSSI5XWZMTJ6VUZNU4JTZRK4ZUWAVCTC6F5KCXYORWZNZ2DA52XQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.692640365 (296h52m48.289411402s) [noise=true , address=77.90.31.13:4629     , piece_id=ZBWI6MHPNXI7UQ7Q3L3VMGBX4YZK5F56MTO337EZ77LGPLQ3OSGQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.693938530 (296h52m48.290709563s) [noise=true , address=79.127.219.41:4926   , piece_id=XZUTTB2A2K4ZWZLND6OJNG3UUFLTITH7CHWOKULUS4RYMF4SI7VQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.694697941 (296h52m48.291468974s) [noise=true , address=145.79.227.26:4658   , piece_id=KV2Q7TQPYETS2P5EK3AYCBWXO75IHPGLMYS7T3EY3DKOQ6HO7QVQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.696419031 (296h52m48.293190063s) [noise=true , address=145.79.227.7:4296    , piece_id=M7NXQQ4U4EHSE3637Y2OLERXE7WN5YONSCFIF72TWI5VDGPHJMMQ, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.697182528 (296h52m48.293953558s) [noise=true , address=45.91.116.5:4301     , piece_id=XMAWGDY5NVLXLA3GJVXXCCBNEA3BAT24XUP3GUAS4QCSP3YR4AOA, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.699322787 (296h52m48.296093822s) [noise=true , address=77.90.31.14:4663     , piece_id=K7P3ERBAXZAF2VWQRGHXKDOMEPWP4GSBRO4YNSWGPZ2XKM7TDUEA, seg_pos={0 0}, upload=332523]: Uploading piece...
Mar 18 19:52:50.784539936 (296h52m48.381310966s) [upload=332523]: Next returned nil segment
Mar 18 19:52:50.784558647 (296h52m48.381329677s) [upload=332523]: Waiting for error group managing segments...
Mar 18 19:52:50.789045308 (296h52m48.385816331s) [noise=true , address=45.91.116.5:4301     , piece_id=XMAWGDY5NVLXLA3GJVXXCCBNEA3BAT24XUP3GUAS4QCSP3YR4AOA, seg_pos={0 0}, upload=332523]: Done uploading piece. err: <nil>
Mar 18 19:52:50.789094040 (296h52m48.385865065s) [noise=true , address=77.90.31.17:4769     , piece_id=3AOOY4K55WRDB76UWX77SASXANARF7PRVZ3O22SLPWV254FDD3GQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: <nil>
Mar 18 19:52:50.798203404 (296h52m48.394974431s) [noise=true , address=77.90.31.18:4805     , piece_id=EXNTVDMKW2PALZMLLUXRUNZYE5BHTHTQVPJUSTJ367HDAI45E3MQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: <nil>
Mar 18 19:52:50.799473878 (296h52m48.396244912s) [noise=true , address=77.90.31.13:4629     , piece_id=ZBWI6MHPNXI7UQ7Q3L3VMGBX4YZK5F56MTO337EZ77LGPLQ3OSGQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: <nil>
Mar 18 19:52:50.799659215 (296h52m48.39643024s) [noise=true , address=77.90.31.14:4663     , piece_id=K7P3ERBAXZAF2VWQRGHXKDOMEPWP4GSBRO4YNSWGPZ2XKM7TDUEA, seg_pos={0 0}, upload=332523]: Done uploading piece. err: <nil>
Mar 18 19:52:50.813523156 (296h52m48.410294187s) [noise=true , address=79.127.219.41:4926   , piece_id=XZUTTB2A2K4ZWZLND6OJNG3UUFLTITH7CHWOKULUS4RYMF4SI7VQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: <nil>
Mar 18 19:53:16.570865535 (296h53m14.167636568s) [noise=true , address=145.79.227.34:4905   , piece_id=SSSDFRJONSSMGDYZANLIKTHQ6HBWT6IFYJDAJSSYIHE5TASNFRGQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:12ffKESNSVpXQzbwJinP6vvgE6zoF3RFz2NRUuuJHvd7bvk1gc9, address:145.79.227.34:4905): protocol: rpc: dial tcp 145.79.227.34:4905: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.570954939 (296h53m14.167725975s) [noise=true , address=145.79.227.23:4551   , piece_id=OIJSN73HORIFMDHQNZJSD7GJY6R4TC3DUUICIJMDHNHR4QADPWJA, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.571490071 (296h53m14.168261104s) [noise=true , address=145.79.227.22:4512   , piece_id=ES4PBUL6SUOZQ26TOHVGLWOWEQVNUSPXCJPDRMEA6TXPJ2RKIPIQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:12cnVqYYfo8b6RvRtMykzh8mU7UAqxcqYvWe7H8G7k8DqtNLAR4, address:145.79.227.22:4512): protocol: rpc: dial tcp 145.79.227.22:4512: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.571614124 (296h53m14.168385158s) [noise=true , address=145.79.227.2:4119    , piece_id=INNE55CDRSMDRPWIQ4P53X7J2YUICGJ5QKQ7MAWC5WFXI2226GNA, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:121xNAnkm9HZXUszp26UmWTsuhp3igyeDVea6gSCdtrQUQDVHpW, address:145.79.227.2:4119): protocol: rpc: dial tcp 145.79.227.2:4119: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.571901972 (296h53m14.168673006s) [noise=true , address=145.79.227.26:4658   , piece_id=KV2Q7TQPYETS2P5EK3AYCBWXO75IHPGLMYS7T3EY3DKOQ6HO7QVQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:1gcSHRechDzTDwivRoAwNFfNj5Zjqvi6oJwVqzbCQinwgWtpPr, address:145.79.227.26:4658): protocol: rpc: dial tcp 145.79.227.26:4658: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.572092048 (296h53m14.168863082s) [noise=true , address=145.79.227.51:4409   , piece_id=76FS44U7FERWPRO72CQ3EIGPN6RQI4QOCRJH4IQ4M57EPWXBQW2Q, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: rpc: dial tcp 145.79.227.51:4409: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.572198851 (296h53m14.168969882s) [noise=true , address=145.79.227.10:4405   , piece_id=SKCT3FGRCXW7QHNZRKBCEYAATJ22QJA4A235434GB5SK6RTPCQYQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:1MCHYW29ZQjE2fHN8P98hDfNRLsjiVqabF86TXz5nZRBPhbGy4, address:145.79.227.10:4405): protocol: rpc: dial tcp 145.79.227.10:4405: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.572455355 (296h53m14.169226389s) [noise=true , address=145.79.227.35:4486   , piece_id=KSSOZCWN5K7QLOGR7ZWQC4MQ5XXPOWTRTMDNJ5TSPL5L7HFIV5JA, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic, address:145.79.227.35:4486): protocol: rpc: dial tcp 145.79.227.35:4486: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.572509808 (296h53m14.16928084s) [noise=true , address=145.79.227.49:4337   , piece_id=NSSI5XWZMTJ6VUZNU4JTZRK4ZUWAVCTC6F5KCXYORWZNZ2DA52XQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE, address:145.79.227.49:4337): protocol: rpc: dial tcp 145.79.227.49:4337: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.572948872 (296h53m14.169719905s) [noise=true , address=145.79.227.7:4296    , piece_id=M7NXQQ4U4EHSE3637Y2OLERXE7WN5YONSCFIF72TWI5VDGPHJMMQ, seg_pos={0 0}, upload=332523]: Done uploading piece. err: ecclient: upload failed (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1, address:145.79.227.7:4296): protocol: rpc: dial tcp 145.79.227.7:4296: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:53:16.573027890 (296h53m14.169798915s) [seg_pos={0 0}, upload=332523]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Mar 18 19:53:16.599059755 (296h53m14.195830769s) [upload=332523]: Done uploading segments...
Mar 18 19:53:16.599099776 (296h53m14.195870803s) [upload=332523]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 30.030508444s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.....................................XXXXXX.XX..............]
duration: 
20.812394242s
trace: 
https://jaeger.dev.storj.io/trace/4b4d10a8051ad01b
FAIL (2026-03-18 19:53:08 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 20.812430477s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [........................................X..........XX..X....]
duration: 
25.068542499s
trace: 
https://jaeger.dev.storj.io/trace/40b499326665cee7
FAIL (2026-03-18 19:53:03 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 18 19:49:22.100496252 (296h49m19.697267275s) [upload=332463]: Starting upload
Mar 18 19:49:22.100562062 (296h49m19.697333097s) [upload=332463]: Done starting upload
Mar 18 19:49:22.100920922 (296h49m19.697691942s) [upload=332463]: Uploading segments...
Mar 18 19:49:22.101052565 (296h49m19.6978236s) [upload=332463]: Got next segment. Inline: false
Mar 18 19:49:22.101122083 (296h49m19.697893113s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:22.101129030 (296h49m19.697900059s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:25.902635706 (296h49m23.499406738s) [seg_pos={0 0}, upload=332463]: Begin upload segment...
Mar 18 19:49:25.902699156 (296h49m23.49947018s) [seg_pos={0 0}, upload=332463]: Done begin upload segment.
Mar 18 19:49:25.902751503 (296h49m23.499522526s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.902763524 (296h49m23.499534558s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.903772480 (296h49m23.500543514s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904336133 (296h49m23.501107164s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904896440 (296h49m23.501667477s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.905706107 (296h49m23.502477153s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906306716 (296h49m23.503077751s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906845104 (296h49m23.503616137s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.907488195 (296h49m23.504259226s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.908477653 (296h49m23.505248679s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.910737637 (296h49m23.507508664s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.912589587 (296h49m23.509360619s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.914513704 (296h49m23.511284737s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.916789871 (296h49m23.513560899s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.918547957 (296h49m23.515318984s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.920615295 (296h49m23.517386321s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.922559454 (296h49m23.519330488s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.925302234 (296h49m23.522073257s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.973039411 (296h49m23.569810434s) [upload=332463]: Next returned nil segment
Mar 18 19:49:25.973052806 (296h49m23.569823829s) [upload=332463]: Waiting for error group managing segments...
Mar 18 19:49:25.995559764 (296h49m23.592330781s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.001337339 (296h49m23.598108384s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.154115776 (296h49m23.750886809s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.253235656 (296h49m23.850006679s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.493998588 (296h49m24.090769614s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.497324258 (296h49m24.094095282s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.504309786 (296h49m24.101080813s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.509531694 (296h49m24.106302708s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.516397335 (296h49m24.113168361s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.533102812 (296h49m24.129873852s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.546130691 (296h49m24.142901714s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.552325489 (296h49m24.149096513s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:28.497314925 (296h49m26.09408595s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:50:22.063196037 (296h50m19.659967069s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1dC7mC2Cbxmys7ukEkELyF9Us7F1qtptSP6yDJh1EfjVJ6uqsC, address:145.79.227.33:4904): protocol: rpc: dial tcp 145.79.227.33:4904: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063515331 (296h50m19.660286364s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg, address:145.79.227.29:4951): protocol: rpc: dial tcp 145.79.227.29:4951: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063750837 (296h50m19.66052187s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1BP2yptVJkJzCKenuKzMZ5sBbVbqXcaoVviwKwrnbxodo1pR5w, address:145.79.227.12:4772): protocol: rpc: dial tcp 145.79.227.12:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063872856 (296h50m19.660643889s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a, address:145.79.227.49:4365): protocol: rpc: dial tcp 145.79.227.49:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064095334 (296h50m19.660866366s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064168331 (296h50m19.660939355s) [seg_pos={0 0}, upload=332463]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:50:22.091389605 (296h50m19.688160629s) [upload=332463]: Done uploading segments...
Mar 18 19:50:22.091441055 (296h50m19.688212078s) [upload=332463]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 25.068608487s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [......................................XXX..........X...X....]
duration: 
25.745933344s
trace: 
https://jaeger.dev.storj.io/trace/6a01088813e3d8b7
FAIL (2026-03-18 19:52:56 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
m: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:08.138517471 (296h49m5.735288494s) [upload=332459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:16.284286759 (296h49m13.881057773s) [seg_pos={0 0}, upload=332459]: Begin upload segment...
Mar 18 19:49:16.284352223 (296h49m13.88112325s) [seg_pos={0 0}, upload=332459]: Done begin upload segment.
Mar 18 19:49:16.284395789 (296h49m13.881166818s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284449689 (296h49m13.881220728s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284549974 (296h49m13.881320988s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285144837 (296h49m13.88191587s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285821284 (296h49m13.882592317s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.286556627 (296h49m13.883327669s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287228779 (296h49m13.883999813s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287269957 (296h49m13.884040985s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287437026 (296h49m13.884208049s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287832890 (296h49m13.884603914s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287952922 (296h49m13.884723957s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288418812 (296h49m13.885189842s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288922438 (296h49m13.885693461s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289343580 (296h49m13.886114604s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289780590 (296h49m13.88655162s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.290237004 (296h49m13.887008027s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.292879809 (296h49m13.889650843s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.293664670 (296h49m13.890435693s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.351440712 (296h49m13.948211724s) [upload=332459]: Next returned nil segment
Mar 18 19:49:16.351460639 (296h49m13.948231661s) [upload=332459]: Waiting for error group managing segments...
Mar 18 19:49:16.355941640 (296h49m13.952712664s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.356991929 (296h49m13.953762955s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.361809763 (296h49m13.958580786s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.367502365 (296h49m13.964273396s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.381549888 (296h49m13.97832091s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.387503503 (296h49m13.984274527s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.498139242 (296h49m14.094910266s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.852944491 (296h49m14.449715518s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.878068834 (296h49m14.474839867s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.892446253 (296h49m14.489217282s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.893099142 (296h49m14.48987017s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:17.031110208 (296h49m14.627881232s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:50:08.096628364 (296h50m5.693399398s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw, address:145.79.227.52:4451): protocol: rpc: dial tcp 145.79.227.52:4451: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096712565 (296h50m5.693483599s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:129LRnDm7b4Fo5db7pto8GXYEtxHz9qdPAtQvaYH6gqdkMatQ6g, address:145.79.227.44:4213): protocol: rpc: dial tcp 145.79.227.44:4213: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096943717 (296h50m5.693714752s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1, address:145.79.227.49:4358): protocol: rpc: dial tcp 145.79.227.49:4358: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097022451 (296h50m5.693793484s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12w88UkGu5duYivJ6L6C9iJmTbnB63fDKiUUQprhwM3JshpXTdC, address:145.79.227.3:4163): protocol: rpc: dial tcp 145.79.227.3:4163: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097155433 (296h50m5.693926468s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75, address:145.79.227.13:4822): protocol: rpc: dial tcp 145.79.227.13:4822: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097360007 (296h50m5.694131039s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1pfQ5v1GwHhFTvh5Y7Jpb9qpWhZhFYqWX9PJpLEUzTkqKWcy4x, address:145.79.227.15:4908): protocol: rpc: dial tcp 145.79.227.15:4908: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097462766 (296h50m5.69423378s) [seg_pos={0 0}, upload=332459]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 18 19:50:08.117913456 (296h50m5.714684468s) [upload=332459]: Done uploading segments...
Mar 18 19:50:08.117999321 (296h50m5.714770348s) [upload=332459]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 25.745961249s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
29 out of 60 is failed (threshold=6) [...........................XXXXXXXXX.XXX...XXXXXXXXXXXXXXXXX]
duration: 
5.00186506s
trace: 
https://jaeger.dev.storj.io/trace/e206aaf571315ce
FAIL (2026-03-18 19:52:49 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001889852s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
23 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXXXXXXX]
duration: 
30.028076107s
trace: 
https://jaeger.dev.storj.io/trace/17f971bdf361b719
FAIL (2026-03-18 19:52:37 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
Mar 18 19:52:07.729963332 (296h52m5.326734355s) [upload=332509]: Starting upload
Mar 18 19:52:07.730068903 (296h52m5.326839935s) [upload=332509]: Done starting upload
Mar 18 19:52:07.730212806 (296h52m5.326983832s) [upload=332509]: Uploading segments...
Mar 18 19:52:07.730454549 (296h52m5.327225563s) [upload=332509]: Got next segment. Inline: false
Mar 18 19:52:07.730518957 (296h52m5.32728998s) [upload=332509]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:52:07.730524593 (296h52m5.327295616s) [upload=332509]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:52:11.472693791 (296h52m9.069464824s) [seg_pos={0 0}, upload=332509]: Begin upload segment...
Mar 18 19:52:11.472805213 (296h52m9.069576231s) [seg_pos={0 0}, upload=332509]: Done begin upload segment.
Mar 18 19:52:11.472879844 (296h52m9.069650878s) [noise=true , address=145.79.227.19:4077   , piece_id=LDI6UC3ITCALQX3RZZGHFAHRUKIN32LLZ2G36PREFQXTJHU5RXUA, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.474057098 (296h52m9.070828123s) [noise=true , address=77.90.31.15:4701     , piece_id=A7AIWKG2KWH3WQ6JQ7TXMUTR2QBB5BY2VF5XB5NXFC4IYOVABJEQ, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.474842686 (296h52m9.071613715s) [noise=true , address=77.90.31.21:4878     , piece_id=ABY35TMVBRMNRDQT3VJ6NIDS7K7KSFBTGDGUMNC67VUSQF3V7ZQA, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.476316040 (296h52m9.073087074s) [noise=true , address=145.79.227.21:4473   , piece_id=FKYTPUUV25REQKAD2IZ5BJDRDR2UKANFF4NXEUSSS5DJUFKFZWCQ, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.477446167 (296h52m9.074217194s) [noise=true , address=145.79.227.45:4233   , piece_id=RGTZHXWUSVDDYTEZMFHJ6XD74DEO2ZPTBXR2XWOJGANT7EQ2REBA, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.477933991 (296h52m9.074705014s) [noise=true , address=45.91.116.8:4048     , piece_id=LVHJQU5RNO7D2ULPFETEMAGRLIZYF4LWZTEO3VLWHAFE2G7TGF6Q, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.478433143 (296h52m9.075204172s) [noise=true , address=145.79.227.30:4762   , piece_id=SSH5CNJESZBHE27DVTEG7GDDOMSGGPH6CEWPTCYZN3HJ6BYD6EWA, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.478972899 (296h52m9.075743932s) [noise=true , address=145.79.227.8:4333    , piece_id=42AVHUFNGOGTYC2K5OGYSX7YH6SUJ32B34L5MJED7IPBUOPNVJ6A, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.479669671 (296h52m9.076440705s) [noise=true , address=145.79.227.2:4115    , piece_id=XYD3JLWRSW2WJCHSPXIWUTHN4SMF4G6XN4GWAVSKDSBYNSSYVNMA, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.482273835 (296h52m9.079044864s) [noise=true , address=77.90.31.16:4736     , piece_id=S4WKIO2J2EYQHHQF5IGEMLAXDRWFQZCBQY3YL4MPPPFFXN6JUQLQ, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.483265669 (296h52m9.080036695s) [noise=true , address=79.127.219.38:4817   , piece_id=G5U5SSPMITR4DGZV3OTBOKL64BQYWOOODICC7AUQLOPLHIURCQZQ, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.484028180 (296h52m9.080799212s) [noise=true , address=45.91.116.9:4261     , piece_id=ETLNJKJHGMZZDJGSKEBGOZMMH6RJUHK4VOOUUMCUP7DA3EKNET2Q, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.484680216 (296h52m9.081451246s) [noise=true , address=145.79.227.51:4412   , piece_id=RPODB7ICP6MCDWLVVE6MNCE3HR3WNFXTXSDQSMCSTNXPHGL6VH2Q, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.485295288 (296h52m9.082066315s) [noise=true , address=145.79.227.44:4196   , piece_id=23NC2CQMQBLH4XIGJLYGTBRW4LCRWVM6VEMDMLPKO5HC7CHRR72Q, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.487584122 (296h52m9.08435515s) [noise=true , address=45.91.116.5:4332     , piece_id=YBVLQPZIJEWKUX3AAML5EOEZFAPD5VBZF7G6PZNADFWODV2QGKKA, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.488461440 (296h52m9.08523247s) [noise=true , address=45.91.116.7:4009     , piece_id=YENOAT4ZH7I3V5NUHIHRZJIGHWJGUVKZ3GIXSMPNDKYN7WHMP7UQ, seg_pos={0 0}, upload=332509]: Uploading piece...
Mar 18 19:52:11.564766031 (296h52m9.161537046s) [upload=332509]: Next returned nil segment
Mar 18 19:52:11.564781840 (296h52m9.161552857s) [upload=332509]: Waiting for error group managing segments...
Mar 18 19:52:11.572581793 (296h52m9.169352806s) [noise=true , address=45.91.116.7:4009     , piece_id=YENOAT4ZH7I3V5NUHIHRZJIGHWJGUVKZ3GIXSMPNDKYN7WHMP7UQ, seg_pos={0 0}, upload=332509]: Done uploading piece. err: <nil>
Mar 18 19:52:11.573205826 (296h52m9.169976841s) [noise=true , address=77.90.31.21:4878     , piece_id=ABY35TMVBRMNRDQT3VJ6NIDS7K7KSFBTGDGUMNC67VUSQF3V7ZQA, seg_pos={0 0}, upload=332509]: Done uploading piece. err: <nil>
Mar 18 19:52:11.574960749 (296h52m9.171731773s) [noise=true , address=77.90.31.16:4736     , piece_id=S4WKIO2J2EYQHHQF5IGEMLAXDRWFQZCBQY3YL4MPPPFFXN6JUQLQ, seg_pos={0 0}, upload=332509]: Done uploading piece. err: <nil>
Mar 18 19:52:11.576012176 (296h52m9.172783188s) [noise=true , address=45.91.116.5:4332     , piece_id=YBVLQPZIJEWKUX3AAML5EOEZFAPD5VBZF7G6PZNADFWODV2QGKKA, seg_pos={0 0}, upload=332509]: Done uploading piece. err: <nil>
Mar 18 19:52:11.578125797 (296h52m9.17489683s) [noise=true , address=77.90.31.15:4701     , piece_id=A7AIWKG2KWH3WQ6JQ7TXMUTR2QBB5BY2VF5XB5NXFC4IYOVABJEQ, seg_pos={0 0}, upload=332509]: Done uploading piece. err: <nil>
Mar 18 19:52:11.578814479 (296h52m9.175585503s) [noise=true , address=45.91.116.8:4048     , piece_id=LVHJQU5RNO7D2ULPFETEMAGRLIZYF4LWZTEO3VLWHAFE2G7TGF6Q, seg_pos={0 0}, upload=332509]: Done uploading piece. err: <nil>
Mar 18 19:52:11.590681633 (296h52m9.187452659s) [noise=true , address=79.127.219.38:4817   , piece_id=G5U5SSPMITR4DGZV3OTBOKL64BQYWOOODICC7AUQLOPLHIURCQZQ, seg_pos={0 0}, upload=332509]: Done uploading piece. err: <nil>
Mar 18 19:52:11.594541666 (296h52m9.191312696s) [noise=true , address=45.91.116.9:4261     , piece_id=ETLNJKJHGMZZDJGSKEBGOZMMH6RJUHK4VOOUUMCUP7DA3EKNET2Q, seg_pos={0 0}, upload=332509]: Done uploading piece. err: <nil>
Mar 18 19:52:37.696699646 (296h52m35.293470676s) [noise=true , address=145.79.227.51:4412   , piece_id=RPODB7ICP6MCDWLVVE6MNCE3HR3WNFXTXSDQSMCSTNXPHGL6VH2Q, seg_pos={0 0}, upload=332509]: Done uploading piece. err: ecclient: upload failed (node:12vBvEfCYZxsv17cVsQTbCQ4YjZfiD4RXjWyz7Ka9ZZrtvzC7SS, address:145.79.227.51:4412): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:52:37.696820644 (296h52m35.293591677s) [noise=true , address=145.79.227.2:4115    , piece_id=XYD3JLWRSW2WJCHSPXIWUTHN4SMF4G6XN4GWAVSKDSBYNSSYVNMA, seg_pos={0 0}, upload=332509]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:145.79.227.2:4115): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:52:37.697027155 (296h52m35.293798188s) [noise=true , address=145.79.227.45:4233   , piece_id=RGTZHXWUSVDDYTEZMFHJ6XD74DEO2ZPTBXR2XWOJGANT7EQ2REBA, seg_pos={0 0}, upload=332509]: Done uploading piece. err: ecclient: upload failed (node:1DmQeoQWTnFhQeJFseJoNYzFyo7vZjYKwDtQVJ6pomksWExsTb, address:145.79.227.45:4233): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:52:37.697224526 (296h52m35.293995543s) [noise=true , address=145.79.227.8:4333    , piece_id=42AVHUFNGOGTYC2K5OGYSX7YH6SUJ32B34L5MJED7IPBUOPNVJ6A, seg_pos={0 0}, upload=332509]: Done uploading piece. err: ecclient: upload failed (node:1xRdTZoEk3NsnS445GcdEvwAdDzNLwUYSfgjB7bBSGRx9L9mrU, address:145.79.227.8:4333): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:52:37.697264105 (296h52m35.294035141s) [noise=true , address=145.79.227.44:4196   , piece_id=23NC2CQMQBLH4XIGJLYGTBRW4LCRWVM6VEMDMLPKO5HC7CHRR72Q, seg_pos={0 0}, upload=332509]: Done uploading piece. err: ecclient: upload failed (node:12Vs4grpszw7MhLJSMgCn7ikaL4jgwSB6XULfVgAt1Msy8hMcaL, address:145.79.227.44:4196): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:52:37.697380442 (296h52m35.294151474s) [noise=true , address=145.79.227.19:4077   , piece_id=LDI6UC3ITCALQX3RZZGHFAHRUKIN32LLZ2G36PREFQXTJHU5RXUA, seg_pos={0 0}, upload=332509]: Done uploading piece. err: ecclient: upload failed (node:12kDJuQP8iLUjB1rXpcNX5TtHzsqa5HvYcUD9Ef64HYTnTXcwLk, address:145.79.227.19:4077): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:52:37.697434916 (296h52m35.294205949s) [noise=true , address=145.79.227.30:4762   , piece_id=SSH5CNJESZBHE27DVTEG7GDDOMSGGPH6CEWPTCYZN3HJ6BYD6EWA, seg_pos={0 0}, upload=332509]: Done uploading piece. err: ecclient: upload failed (node:1No1jHEK6YFSye92GGBri48Yv2DYUiESY6Gs3Z9PENjmBynS9b, address:145.79.227.30:4762): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:52:37.697513762 (296h52m35.294284801s) [noise=true , address=145.79.227.21:4473   , piece_id=FKYTPUUV25REQKAD2IZ5BJDRDR2UKANFF4NXEUSSS5DJUFKFZWCQ, seg_pos={0 0}, upload=332509]: Done uploading piece. err: ecclient: upload failed (node:12DDe4jT3YeUH8qMQgapcvzMnFs8UFB8fTmubho4ZQf5tYVoxuk, address:145.79.227.21:4473): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:52:37.697541470 (296h52m35.294312489s) [seg_pos={0 0}, upload=332509]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Mar 18 19:52:37.722950488 (296h52m35.319721512s) [upload=332509]: Done uploading segments...
Mar 18 19:52:37.722988940 (296h52m35.319759964s) [upload=332509]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 30.028101179s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.........................................X..........XX..X...]
duration: 
16.175428606s
trace: 
https://jaeger.dev.storj.io/trace/40b499326665cee7
FAIL (2026-03-18 19:52:29 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 18 19:49:22.100496252 (296h49m19.697267275s) [upload=332463]: Starting upload
Mar 18 19:49:22.100562062 (296h49m19.697333097s) [upload=332463]: Done starting upload
Mar 18 19:49:22.100920922 (296h49m19.697691942s) [upload=332463]: Uploading segments...
Mar 18 19:49:22.101052565 (296h49m19.6978236s) [upload=332463]: Got next segment. Inline: false
Mar 18 19:49:22.101122083 (296h49m19.697893113s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:22.101129030 (296h49m19.697900059s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:25.902635706 (296h49m23.499406738s) [seg_pos={0 0}, upload=332463]: Begin upload segment...
Mar 18 19:49:25.902699156 (296h49m23.49947018s) [seg_pos={0 0}, upload=332463]: Done begin upload segment.
Mar 18 19:49:25.902751503 (296h49m23.499522526s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.902763524 (296h49m23.499534558s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.903772480 (296h49m23.500543514s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904336133 (296h49m23.501107164s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904896440 (296h49m23.501667477s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.905706107 (296h49m23.502477153s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906306716 (296h49m23.503077751s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906845104 (296h49m23.503616137s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.907488195 (296h49m23.504259226s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.908477653 (296h49m23.505248679s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.910737637 (296h49m23.507508664s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.912589587 (296h49m23.509360619s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.914513704 (296h49m23.511284737s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.916789871 (296h49m23.513560899s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.918547957 (296h49m23.515318984s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.920615295 (296h49m23.517386321s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.922559454 (296h49m23.519330488s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.925302234 (296h49m23.522073257s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.973039411 (296h49m23.569810434s) [upload=332463]: Next returned nil segment
Mar 18 19:49:25.973052806 (296h49m23.569823829s) [upload=332463]: Waiting for error group managing segments...
Mar 18 19:49:25.995559764 (296h49m23.592330781s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.001337339 (296h49m23.598108384s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.154115776 (296h49m23.750886809s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.253235656 (296h49m23.850006679s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.493998588 (296h49m24.090769614s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.497324258 (296h49m24.094095282s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.504309786 (296h49m24.101080813s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.509531694 (296h49m24.106302708s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.516397335 (296h49m24.113168361s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.533102812 (296h49m24.129873852s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.546130691 (296h49m24.142901714s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.552325489 (296h49m24.149096513s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:28.497314925 (296h49m26.09408595s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:50:22.063196037 (296h50m19.659967069s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1dC7mC2Cbxmys7ukEkELyF9Us7F1qtptSP6yDJh1EfjVJ6uqsC, address:145.79.227.33:4904): protocol: rpc: dial tcp 145.79.227.33:4904: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063515331 (296h50m19.660286364s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg, address:145.79.227.29:4951): protocol: rpc: dial tcp 145.79.227.29:4951: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063750837 (296h50m19.66052187s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1BP2yptVJkJzCKenuKzMZ5sBbVbqXcaoVviwKwrnbxodo1pR5w, address:145.79.227.12:4772): protocol: rpc: dial tcp 145.79.227.12:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063872856 (296h50m19.660643889s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a, address:145.79.227.49:4365): protocol: rpc: dial tcp 145.79.227.49:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064095334 (296h50m19.660866366s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064168331 (296h50m19.660939355s) [seg_pos={0 0}, upload=332463]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:50:22.091389605 (296h50m19.688160629s) [upload=332463]: Done uploading segments...
Mar 18 19:50:22.091441055 (296h50m19.688212078s) [upload=332463]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 16.175456226s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [......................................XXXXXX.XX.............]
duration: 
16.682599945s
trace: 
https://jaeger.dev.storj.io/trace/4b4d10a8051ad01b
FAIL (2026-03-18 19:51:53 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 16.682641969s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [.......................................XXX..........X...X...]
duration: 
16.881080722s
trace: 
https://jaeger.dev.storj.io/trace/6a01088813e3d8b7
FAIL (2026-03-18 19:51:51 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
m: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:08.138517471 (296h49m5.735288494s) [upload=332459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:16.284286759 (296h49m13.881057773s) [seg_pos={0 0}, upload=332459]: Begin upload segment...
Mar 18 19:49:16.284352223 (296h49m13.88112325s) [seg_pos={0 0}, upload=332459]: Done begin upload segment.
Mar 18 19:49:16.284395789 (296h49m13.881166818s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284449689 (296h49m13.881220728s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284549974 (296h49m13.881320988s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285144837 (296h49m13.88191587s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285821284 (296h49m13.882592317s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.286556627 (296h49m13.883327669s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287228779 (296h49m13.883999813s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287269957 (296h49m13.884040985s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287437026 (296h49m13.884208049s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287832890 (296h49m13.884603914s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287952922 (296h49m13.884723957s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288418812 (296h49m13.885189842s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288922438 (296h49m13.885693461s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289343580 (296h49m13.886114604s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289780590 (296h49m13.88655162s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.290237004 (296h49m13.887008027s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.292879809 (296h49m13.889650843s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.293664670 (296h49m13.890435693s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.351440712 (296h49m13.948211724s) [upload=332459]: Next returned nil segment
Mar 18 19:49:16.351460639 (296h49m13.948231661s) [upload=332459]: Waiting for error group managing segments...
Mar 18 19:49:16.355941640 (296h49m13.952712664s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.356991929 (296h49m13.953762955s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.361809763 (296h49m13.958580786s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.367502365 (296h49m13.964273396s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.381549888 (296h49m13.97832091s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.387503503 (296h49m13.984274527s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.498139242 (296h49m14.094910266s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.852944491 (296h49m14.449715518s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.878068834 (296h49m14.474839867s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.892446253 (296h49m14.489217282s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.893099142 (296h49m14.48987017s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:17.031110208 (296h49m14.627881232s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:50:08.096628364 (296h50m5.693399398s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw, address:145.79.227.52:4451): protocol: rpc: dial tcp 145.79.227.52:4451: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096712565 (296h50m5.693483599s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:129LRnDm7b4Fo5db7pto8GXYEtxHz9qdPAtQvaYH6gqdkMatQ6g, address:145.79.227.44:4213): protocol: rpc: dial tcp 145.79.227.44:4213: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096943717 (296h50m5.693714752s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1, address:145.79.227.49:4358): protocol: rpc: dial tcp 145.79.227.49:4358: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097022451 (296h50m5.693793484s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12w88UkGu5duYivJ6L6C9iJmTbnB63fDKiUUQprhwM3JshpXTdC, address:145.79.227.3:4163): protocol: rpc: dial tcp 145.79.227.3:4163: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097155433 (296h50m5.693926468s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75, address:145.79.227.13:4822): protocol: rpc: dial tcp 145.79.227.13:4822: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097360007 (296h50m5.694131039s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1pfQ5v1GwHhFTvh5Y7Jpb9qpWhZhFYqWX9PJpLEUzTkqKWcy4x, address:145.79.227.15:4908): protocol: rpc: dial tcp 145.79.227.15:4908: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097462766 (296h50m5.69423378s) [seg_pos={0 0}, upload=332459]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 18 19:50:08.117913456 (296h50m5.714684468s) [upload=332459]: Done uploading segments...
Mar 18 19:50:08.117999321 (296h50m5.714770348s) [upload=332459]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 16.881129386s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
28 out of 60 is failed (threshold=6) [............................XXXXXXXXX.XXX...XXXXXXXXXXXXXXXX]
duration: 
5.00112601s
trace: 
https://jaeger.dev.storj.io/trace/63c5f946daec4a75
FAIL (2026-03-18 19:51:47 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.00115573s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX]
duration: 
30.035221542s
trace: 
https://jaeger.dev.storj.io/trace/45a99c39cb867491
FAIL (2026-03-18 19:51:40 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
17872 (296h51m7.663388906s) [upload=332494]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:51:14.080286629 (296h51m11.677057654s) [seg_pos={0 0}, upload=332494]: Begin upload segment...
Mar 18 19:51:14.080364054 (296h51m11.677135078s) [seg_pos={0 0}, upload=332494]: Done begin upload segment.
Mar 18 19:51:14.080414730 (296h51m11.677185772s) [noise=true , address=145.79.227.37:4567   , piece_id=ETAGHWAAPSNR5XFNGBK4MVULW5VLHZWSGOCXE4KUCP7QAMLZ56GA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.080516066 (296h51m11.677287093s) [noise=true , address=77.90.31.11:4555     , piece_id=JASKERZBBF4CFAW7FHBJMPI35SNXOZTAH23FNQTJENSKQZYB62BA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.081184422 (296h51m11.677955452s) [noise=true , address=45.91.116.13:4157    , piece_id=WD6YBAREEZC5DZFKUFNBIRANK7A53EEF37KPZXTPV2WPVSWZ5JZQ, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.081267099 (296h51m11.678038132s) [noise=true , address=145.79.227.36:4522   , piece_id=I2CKWI3KLMQPI65ULPBC6KZ2EGDPEAYNDWAAIDL3IWAFKFAO45DA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.081816175 (296h51m11.678587209s) [noise=true , address=145.79.227.12:4769   , piece_id=QUCF5JD45V3M7AJP7JIFP754GER4UF3WIEBQ2LXUJUAA4EBR3LEQ, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.082297551 (296h51m11.679068578s) [noise=true , address=145.79.227.25:4622   , piece_id=I2CXGWIU3P3ZES6AHLILY66I32AJED3FO7OZ57P52N3A4CUDHXBA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.082758435 (296h51m11.679529463s) [noise=true , address=45.91.116.8:4079     , piece_id=NRQHI6E7D36FZSLARJLPEWHUFZZ55SC7PAAZQRGLNPAIZ6GOEGAA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.083310014 (296h51m11.680081039s) [noise=true , address=77.90.31.14:4665     , piece_id=H7WLRC2LUGRR5UGO6CBMHU6D3B4NTLI7VKRT2UIHSYMEVHJFP6FA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.083821270 (296h51m11.680592296s) [noise=true , address=145.79.227.49:4340   , piece_id=VCGCAFBRVJJD4M2GAMFKR6IGSWQ4WRQBDVHGH52N3G5QHZMRNXXA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.083987838 (296h51m11.680758871s) [noise=true , address=145.79.227.43:4159   , piece_id=SWMWFWPKU7Y7SFEG7IMII2SIGPNF67SVZQ72TA63JWMMYR6IWILA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.084380011 (296h51m11.68115105s) [noise=true , address=77.90.31.21:4880     , piece_id=WNWEA4MA4Q5VMABWCJAQGURKNC6RPPKPLTSFXHNFE4MZRKDSZCVA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.084968359 (296h51m11.681739381s) [noise=true , address=77.90.31.12:4593     , piece_id=JVQSJNQRLLEE3IRI67JYNH4HQXWH3WUMDG6PQBX4JOU3CA7SF6TA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.085425204 (296h51m11.682196233s) [noise=true , address=145.79.227.40:4051   , piece_id=Y6XTIDPARQRWLU3HLA6EN4Z3ASAQVDMCDNDS4KQHPS5K2GN7JR7A, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.085807468 (296h51m11.682578495s) [noise=true , address=145.79.227.19:4083   , piece_id=44IRKZWHEKXE3H3KZXJOB7KSJWFVD5DNTOMYGPIKZA7HYFTEYZZQ, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.087861273 (296h51m11.684632297s) [noise=true , address=145.79.227.22:4513   , piece_id=3WGVD5HMNMUQX7WKV3QULQXEW3JURKFTMIMPDQMLRNK4D5YRTCCQ, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.089813359 (296h51m11.686584386s) [noise=true , address=145.79.227.32:4833   , piece_id=YKK5IQWKZPUAENSNEWAF2GS57VJZBA7BELVUBKYCU2AL7LWTITYA, seg_pos={0 0}, upload=332494]: Uploading piece...
Mar 18 19:51:14.157683854 (296h51m11.754454888s) [upload=332494]: Next returned nil segment
Mar 18 19:51:14.157701898 (296h51m11.754472932s) [upload=332494]: Waiting for error group managing segments...
Mar 18 19:51:14.161946235 (296h51m11.758717265s) [noise=true , address=77.90.31.11:4555     , piece_id=JASKERZBBF4CFAW7FHBJMPI35SNXOZTAH23FNQTJENSKQZYB62BA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: <nil>
Mar 18 19:51:14.162520137 (296h51m11.759291166s) [noise=true , address=45.91.116.8:4079     , piece_id=NRQHI6E7D36FZSLARJLPEWHUFZZ55SC7PAAZQRGLNPAIZ6GOEGAA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: <nil>
Mar 18 19:51:14.162867643 (296h51m11.759638667s) [noise=true , address=77.90.31.21:4880     , piece_id=WNWEA4MA4Q5VMABWCJAQGURKNC6RPPKPLTSFXHNFE4MZRKDSZCVA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: <nil>
Mar 18 19:51:14.163551239 (296h51m11.760322268s) [noise=true , address=45.91.116.13:4157    , piece_id=WD6YBAREEZC5DZFKUFNBIRANK7A53EEF37KPZXTPV2WPVSWZ5JZQ, seg_pos={0 0}, upload=332494]: Done uploading piece. err: <nil>
Mar 18 19:51:14.163735354 (296h51m11.760506391s) [noise=true , address=77.90.31.12:4593     , piece_id=JVQSJNQRLLEE3IRI67JYNH4HQXWH3WUMDG6PQBX4JOU3CA7SF6TA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: <nil>
Mar 18 19:51:14.185104409 (296h51m11.781875432s) [noise=true , address=77.90.31.14:4665     , piece_id=H7WLRC2LUGRR5UGO6CBMHU6D3B4NTLI7VKRT2UIHSYMEVHJFP6FA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: <nil>
Mar 18 19:51:40.022688865 (296h51m37.619459897s) [noise=true , address=145.79.227.19:4083   , piece_id=44IRKZWHEKXE3H3KZXJOB7KSJWFVD5DNTOMYGPIKZA7HYFTEYZZQ, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:12KZ5a6CQ9tUTrC6EYE7M8yg6p9fK95CN8zQLQmP4tdyz4rBfGh, address:145.79.227.19:4083): protocol: rpc: dial tcp 145.79.227.19:4083: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.023076483 (296h51m37.619847516s) [noise=true , address=145.79.227.25:4622   , piece_id=I2CXGWIU3P3ZES6AHLILY66I32AJED3FO7OZ57P52N3A4CUDHXBA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs, address:145.79.227.25:4622): protocol: rpc: dial tcp 145.79.227.25:4622: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.023270845 (296h51m37.620041874s) [noise=true , address=145.79.227.32:4833   , piece_id=YKK5IQWKZPUAENSNEWAF2GS57VJZBA7BELVUBKYCU2AL7LWTITYA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:127L5Mr53vCqKr4gy7N4rAaVCC9FvU8XdYKFrxWrJL728dt3LmR, address:145.79.227.32:4833): protocol: rpc: dial tcp 145.79.227.32:4833: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.023598856 (296h51m37.62036989s) [noise=true , address=145.79.227.43:4159   , piece_id=SWMWFWPKU7Y7SFEG7IMII2SIGPNF67SVZQ72TA63JWMMYR6IWILA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:12ULUPKjJwZocjV1R6Dy7vmWSrZ4hKx3YAHLAihgtMKf8Uw2UgA, address:145.79.227.43:4159): protocol: rpc: dial tcp 145.79.227.43:4159: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.024021600 (296h51m37.620792633s) [noise=true , address=145.79.227.40:4051   , piece_id=Y6XTIDPARQRWLU3HLA6EN4Z3ASAQVDMCDNDS4KQHPS5K2GN7JR7A, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:12rPbTARUrq7YsD8X75ocnyEvC517itk79s3Dp1wUg72fVuBS8n, address:145.79.227.40:4051): protocol: rpc: dial tcp 145.79.227.40:4051: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.024244582 (296h51m37.621015671s) [noise=true , address=145.79.227.12:4769   , piece_id=QUCF5JD45V3M7AJP7JIFP754GER4UF3WIEBQ2LXUJUAA4EBR3LEQ, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:1CNSBmPmCSQ6gHKNcWrFAy3VU7Rf2ukMYQpkdurgZLPmqotWQ6, address:145.79.227.12:4769): protocol: rpc: dial tcp 145.79.227.12:4769: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.024496639 (296h51m37.621267686s) [noise=true , address=145.79.227.36:4522   , piece_id=I2CKWI3KLMQPI65ULPBC6KZ2EGDPEAYNDWAAIDL3IWAFKFAO45DA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:1zGZe6e37uop4y622fU1GbspMPVEZURS3FbMrf7je6VT9TYGFr, address:145.79.227.36:4522): protocol: rpc: dial tcp 145.79.227.36:4522: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.024701664 (296h51m37.621472696s) [noise=true , address=145.79.227.22:4513   , piece_id=3WGVD5HMNMUQX7WKV3QULQXEW3JURKFTMIMPDQMLRNK4D5YRTCCQ, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:12BykEXT7spgn4jkPucFmPvjvgKPKi5fZgRAeMTbfecZ7jCNori, address:145.79.227.22:4513): protocol: rpc: dial tcp 145.79.227.22:4513: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.032239413 (296h51m37.62901045s) [noise=true , address=145.79.227.49:4340   , piece_id=VCGCAFBRVJJD4M2GAMFKR6IGSWQ4WRQBDVHGH52N3G5QHZMRNXXA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC, address:145.79.227.49:4340): protocol: rpc: dial tcp 145.79.227.49:4340: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.033090786 (296h51m37.629861819s) [noise=true , address=145.79.227.37:4567   , piece_id=ETAGHWAAPSNR5XFNGBK4MVULW5VLHZWSGOCXE4KUCP7QAMLZ56GA, seg_pos={0 0}, upload=332494]: Done uploading piece. err: ecclient: upload failed (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS, address:145.79.227.37:4567): protocol: rpc: dial tcp 145.79.227.37:4567: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:51:40.033728950 (296h51m37.63049998s) [seg_pos={0 0}, upload=332494]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Mar 18 19:51:40.056007896 (296h51m37.652778922s) [upload=332494]: Done uploading segments...
Mar 18 19:51:40.056071623 (296h51m37.652842654s) [upload=332494]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 30.035249812s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [..........................................X..........XX..X..]
duration: 
23.242601449s
trace: 
https://jaeger.dev.storj.io/trace/40b499326665cee7
FAIL (2026-03-18 19:51:28 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 18 19:49:22.100496252 (296h49m19.697267275s) [upload=332463]: Starting upload
Mar 18 19:49:22.100562062 (296h49m19.697333097s) [upload=332463]: Done starting upload
Mar 18 19:49:22.100920922 (296h49m19.697691942s) [upload=332463]: Uploading segments...
Mar 18 19:49:22.101052565 (296h49m19.6978236s) [upload=332463]: Got next segment. Inline: false
Mar 18 19:49:22.101122083 (296h49m19.697893113s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:22.101129030 (296h49m19.697900059s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:25.902635706 (296h49m23.499406738s) [seg_pos={0 0}, upload=332463]: Begin upload segment...
Mar 18 19:49:25.902699156 (296h49m23.49947018s) [seg_pos={0 0}, upload=332463]: Done begin upload segment.
Mar 18 19:49:25.902751503 (296h49m23.499522526s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.902763524 (296h49m23.499534558s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.903772480 (296h49m23.500543514s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904336133 (296h49m23.501107164s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904896440 (296h49m23.501667477s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.905706107 (296h49m23.502477153s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906306716 (296h49m23.503077751s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906845104 (296h49m23.503616137s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.907488195 (296h49m23.504259226s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.908477653 (296h49m23.505248679s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.910737637 (296h49m23.507508664s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.912589587 (296h49m23.509360619s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.914513704 (296h49m23.511284737s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.916789871 (296h49m23.513560899s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.918547957 (296h49m23.515318984s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.920615295 (296h49m23.517386321s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.922559454 (296h49m23.519330488s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.925302234 (296h49m23.522073257s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.973039411 (296h49m23.569810434s) [upload=332463]: Next returned nil segment
Mar 18 19:49:25.973052806 (296h49m23.569823829s) [upload=332463]: Waiting for error group managing segments...
Mar 18 19:49:25.995559764 (296h49m23.592330781s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.001337339 (296h49m23.598108384s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.154115776 (296h49m23.750886809s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.253235656 (296h49m23.850006679s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.493998588 (296h49m24.090769614s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.497324258 (296h49m24.094095282s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.504309786 (296h49m24.101080813s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.509531694 (296h49m24.106302708s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.516397335 (296h49m24.113168361s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.533102812 (296h49m24.129873852s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.546130691 (296h49m24.142901714s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.552325489 (296h49m24.149096513s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:28.497314925 (296h49m26.09408595s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:50:22.063196037 (296h50m19.659967069s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1dC7mC2Cbxmys7ukEkELyF9Us7F1qtptSP6yDJh1EfjVJ6uqsC, address:145.79.227.33:4904): protocol: rpc: dial tcp 145.79.227.33:4904: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063515331 (296h50m19.660286364s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg, address:145.79.227.29:4951): protocol: rpc: dial tcp 145.79.227.29:4951: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063750837 (296h50m19.66052187s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1BP2yptVJkJzCKenuKzMZ5sBbVbqXcaoVviwKwrnbxodo1pR5w, address:145.79.227.12:4772): protocol: rpc: dial tcp 145.79.227.12:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063872856 (296h50m19.660643889s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a, address:145.79.227.49:4365): protocol: rpc: dial tcp 145.79.227.49:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064095334 (296h50m19.660866366s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064168331 (296h50m19.660939355s) [seg_pos={0 0}, upload=332463]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:50:22.091389605 (296h50m19.688160629s) [upload=332463]: Done uploading segments...
Mar 18 19:50:22.091441055 (296h50m19.688212078s) [upload=332463]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 23.242651517s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [........................................XXX..........X...X..]
duration: 
25.753471305s
trace: 
https://jaeger.dev.storj.io/trace/6a01088813e3d8b7
FAIL (2026-03-18 19:51:21 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
m: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:08.138517471 (296h49m5.735288494s) [upload=332459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:16.284286759 (296h49m13.881057773s) [seg_pos={0 0}, upload=332459]: Begin upload segment...
Mar 18 19:49:16.284352223 (296h49m13.88112325s) [seg_pos={0 0}, upload=332459]: Done begin upload segment.
Mar 18 19:49:16.284395789 (296h49m13.881166818s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284449689 (296h49m13.881220728s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284549974 (296h49m13.881320988s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285144837 (296h49m13.88191587s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285821284 (296h49m13.882592317s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.286556627 (296h49m13.883327669s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287228779 (296h49m13.883999813s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287269957 (296h49m13.884040985s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287437026 (296h49m13.884208049s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287832890 (296h49m13.884603914s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287952922 (296h49m13.884723957s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288418812 (296h49m13.885189842s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288922438 (296h49m13.885693461s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289343580 (296h49m13.886114604s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289780590 (296h49m13.88655162s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.290237004 (296h49m13.887008027s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.292879809 (296h49m13.889650843s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.293664670 (296h49m13.890435693s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.351440712 (296h49m13.948211724s) [upload=332459]: Next returned nil segment
Mar 18 19:49:16.351460639 (296h49m13.948231661s) [upload=332459]: Waiting for error group managing segments...
Mar 18 19:49:16.355941640 (296h49m13.952712664s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.356991929 (296h49m13.953762955s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.361809763 (296h49m13.958580786s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.367502365 (296h49m13.964273396s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.381549888 (296h49m13.97832091s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.387503503 (296h49m13.984274527s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.498139242 (296h49m14.094910266s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.852944491 (296h49m14.449715518s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.878068834 (296h49m14.474839867s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.892446253 (296h49m14.489217282s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.893099142 (296h49m14.48987017s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:17.031110208 (296h49m14.627881232s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:50:08.096628364 (296h50m5.693399398s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw, address:145.79.227.52:4451): protocol: rpc: dial tcp 145.79.227.52:4451: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096712565 (296h50m5.693483599s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:129LRnDm7b4Fo5db7pto8GXYEtxHz9qdPAtQvaYH6gqdkMatQ6g, address:145.79.227.44:4213): protocol: rpc: dial tcp 145.79.227.44:4213: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096943717 (296h50m5.693714752s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1, address:145.79.227.49:4358): protocol: rpc: dial tcp 145.79.227.49:4358: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097022451 (296h50m5.693793484s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12w88UkGu5duYivJ6L6C9iJmTbnB63fDKiUUQprhwM3JshpXTdC, address:145.79.227.3:4163): protocol: rpc: dial tcp 145.79.227.3:4163: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097155433 (296h50m5.693926468s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75, address:145.79.227.13:4822): protocol: rpc: dial tcp 145.79.227.13:4822: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097360007 (296h50m5.694131039s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1pfQ5v1GwHhFTvh5Y7Jpb9qpWhZhFYqWX9PJpLEUzTkqKWcy4x, address:145.79.227.15:4908): protocol: rpc: dial tcp 145.79.227.15:4908: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097462766 (296h50m5.69423378s) [seg_pos={0 0}, upload=332459]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 18 19:50:08.117913456 (296h50m5.714684468s) [upload=332459]: Done uploading segments...
Mar 18 19:50:08.117999321 (296h50m5.714770348s) [upload=332459]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 25.753494516s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.......................................XXXXXX.XX............]
duration: 
20.019614078s
trace: 
https://jaeger.dev.storj.io/trace/4b4d10a8051ad01b
FAIL (2026-03-18 19:51:06 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 20.019630614s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
27 out of 60 is failed (threshold=6) [.............................XXXXXXXXX.XXX...XXXXXXXXXXXXXXX]
duration: 
5.001319332s
trace: 
https://jaeger.dev.storj.io/trace/5b2aa63db5cf40ac
FAIL (2026-03-18 19:50:56 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001341082s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [...........................................X..........XX..X.]
duration: 
20.938031267s
trace: 
https://jaeger.dev.storj.io/trace/40b499326665cee7
FAIL (2026-03-18 19:50:55 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 18 19:49:22.100496252 (296h49m19.697267275s) [upload=332463]: Starting upload
Mar 18 19:49:22.100562062 (296h49m19.697333097s) [upload=332463]: Done starting upload
Mar 18 19:49:22.100920922 (296h49m19.697691942s) [upload=332463]: Uploading segments...
Mar 18 19:49:22.101052565 (296h49m19.6978236s) [upload=332463]: Got next segment. Inline: false
Mar 18 19:49:22.101122083 (296h49m19.697893113s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:22.101129030 (296h49m19.697900059s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:25.902635706 (296h49m23.499406738s) [seg_pos={0 0}, upload=332463]: Begin upload segment...
Mar 18 19:49:25.902699156 (296h49m23.49947018s) [seg_pos={0 0}, upload=332463]: Done begin upload segment.
Mar 18 19:49:25.902751503 (296h49m23.499522526s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.902763524 (296h49m23.499534558s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.903772480 (296h49m23.500543514s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904336133 (296h49m23.501107164s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904896440 (296h49m23.501667477s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.905706107 (296h49m23.502477153s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906306716 (296h49m23.503077751s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906845104 (296h49m23.503616137s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.907488195 (296h49m23.504259226s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.908477653 (296h49m23.505248679s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.910737637 (296h49m23.507508664s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.912589587 (296h49m23.509360619s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.914513704 (296h49m23.511284737s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.916789871 (296h49m23.513560899s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.918547957 (296h49m23.515318984s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.920615295 (296h49m23.517386321s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.922559454 (296h49m23.519330488s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.925302234 (296h49m23.522073257s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.973039411 (296h49m23.569810434s) [upload=332463]: Next returned nil segment
Mar 18 19:49:25.973052806 (296h49m23.569823829s) [upload=332463]: Waiting for error group managing segments...
Mar 18 19:49:25.995559764 (296h49m23.592330781s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.001337339 (296h49m23.598108384s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.154115776 (296h49m23.750886809s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.253235656 (296h49m23.850006679s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.493998588 (296h49m24.090769614s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.497324258 (296h49m24.094095282s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.504309786 (296h49m24.101080813s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.509531694 (296h49m24.106302708s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.516397335 (296h49m24.113168361s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.533102812 (296h49m24.129873852s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.546130691 (296h49m24.142901714s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.552325489 (296h49m24.149096513s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:28.497314925 (296h49m26.09408595s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:50:22.063196037 (296h50m19.659967069s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1dC7mC2Cbxmys7ukEkELyF9Us7F1qtptSP6yDJh1EfjVJ6uqsC, address:145.79.227.33:4904): protocol: rpc: dial tcp 145.79.227.33:4904: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063515331 (296h50m19.660286364s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg, address:145.79.227.29:4951): protocol: rpc: dial tcp 145.79.227.29:4951: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063750837 (296h50m19.66052187s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1BP2yptVJkJzCKenuKzMZ5sBbVbqXcaoVviwKwrnbxodo1pR5w, address:145.79.227.12:4772): protocol: rpc: dial tcp 145.79.227.12:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063872856 (296h50m19.660643889s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a, address:145.79.227.49:4365): protocol: rpc: dial tcp 145.79.227.49:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064095334 (296h50m19.660866366s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064168331 (296h50m19.660939355s) [seg_pos={0 0}, upload=332463]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:50:22.091389605 (296h50m19.688160629s) [upload=332463]: Done uploading segments...
Mar 18 19:50:22.091441055 (296h50m19.688212078s) [upload=332463]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 20.938057168s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX]
duration: 
30.033929107s
trace: 
https://jaeger.dev.storj.io/trace/59042e3dcf8aac47
FAIL (2026-03-18 19:50:47 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Mar 18 19:50:17.628440911 (296h50m15.22521194s) [upload=332478]: Starting upload
Mar 18 19:50:17.628579820 (296h50m15.225350848s) [upload=332478]: Done starting upload
Mar 18 19:50:17.628825064 (296h50m15.225596074s) [upload=332478]: Uploading segments...
Mar 18 19:50:17.629579311 (296h50m15.226350334s) [upload=332478]: Got next segment. Inline: false
Mar 18 19:50:17.629698061 (296h50m15.226469084s) [upload=332478]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:50:17.629704871 (296h50m15.226475897s) [upload=332478]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:50:21.782832322 (296h50m19.379603334s) [seg_pos={0 0}, upload=332478]: Begin upload segment...
Mar 18 19:50:21.782922958 (296h50m19.379693978s) [seg_pos={0 0}, upload=332478]: Done begin upload segment.
Mar 18 19:50:21.782988472 (296h50m19.379759498s) [noise=true , address=145.79.227.33:4871   , piece_id=SPV5CLP4F7AATHLEIG3Y436GYR4VXYY6WP7C7MQBSOM7FBNEGSLQ, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.784087764 (296h50m19.380858796s) [noise=true , address=77.90.31.11:4553     , piece_id=VIOPLQQB6UXL3FRE56CPDLIUHNEN6QQ4E3FFXQPXWJM27VSY3H2A, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.784189839 (296h50m19.380960871s) [noise=true , address=79.127.219.46:4890   , piece_id=562FBVBOV2SVOQUFCTLWAC376TCVAQQRLHDUNVTUFY7HRKXKSKLQ, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.784590225 (296h50m19.381361249s) [noise=true , address=79.127.219.41:4927   , piece_id=NYZQF7S6I6OTM6VHFNJAKSXVNZFHIATMJ6PNDUM6L35UXVJA624Q, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.784690514 (296h50m19.381461543s) [noise=true , address=145.79.227.21:4477   , piece_id=CA5762SLX257ISX26VRUFNVGBXW55WFQH2YGT4FRV4WVAGVSBDOA, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.785052043 (296h50m19.381823078s) [noise=true , address=77.90.31.15:4701     , piece_id=C6E5S2O2IQIWGJSEN5GMHASLIXSUSUFKEESBN5VGRRQB67CH5OGQ, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.785235534 (296h50m19.382006559s) [noise=true , address=145.79.227.50:4377   , piece_id=4DEGGLRDMUUK3WRVM2ELQJVKGNQGF53MOD33B3MJ4JRXQANCV33Q, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.785506956 (296h50m19.382277997s) [noise=true , address=45.91.116.5:4297     , piece_id=FQ2FDGMNT22U66JWRQYPKCTTQ2LXFQ7W2B6W4RSFDJAB6U4GB2CA, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.785772034 (296h50m19.382543061s) [noise=true , address=77.90.31.21:4878     , piece_id=DIW3KLODOARSM5CGFYGMRH4PUY72NONBXLDDSUGQZ4BWN7UZMHFQ, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.785937616 (296h50m19.382708648s) [noise=true , address=77.90.31.12:4593     , piece_id=K6TFXKLKVTAYKSBHHQOEXLJCJU4M5L56VL2AI2Y2VNRIU6EJA3TQ, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.786228605 (296h50m19.382999631s) [noise=true , address=145.79.227.10:4406   , piece_id=5G46V2GAVCF5DJY354RHQLNXLDCDUKBZYTCMEJNJI642WFMSHDAQ, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.786319282 (296h50m19.383090315s) [noise=true , address=45.91.116.14:4224    , piece_id=EYNJRKQ3K7IV6DLV63DLXAYWK4FHFOQOMGJ56IGWAT7QFLYNUJ2A, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.786721625 (296h50m19.383492659s) [noise=true , address=45.91.116.13:4156    , piece_id=HJYR3FQR4L5IEWKQXB3VQXX2UUXXAZKX2BRW43UC7HQG7MY6RK2Q, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.786763837 (296h50m19.38353487s) [noise=true , address=45.91.116.10:4088    , piece_id=UCX4YPV5WXHTNPH466TXDHV5SW77OKR2ITS62UURCP23PJS52SNQ, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.787273053 (296h50m19.384044079s) [noise=true , address=145.79.227.23:4548   , piece_id=TFZE2JQ6CXDN4SY5KWVG3SIW6FRDT5EKF6PRRYINAGRQU4BVPOLQ, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.789443799 (296h50m19.386214833s) [noise=true , address=145.79.227.13:4803   , piece_id=7P5GGVIV2JXXYLEC4JQ4EK5JJIHRRWBYXT3V4HPHEKC6UUV47CPQ, seg_pos={0 0}, upload=332478]: Uploading piece...
Mar 18 19:50:21.856469154 (296h50m19.453240178s) [upload=332478]: Next returned nil segment
Mar 18 19:50:21.856485568 (296h50m19.453256591s) [upload=332478]: Waiting for error group managing segments...
Mar 18 19:50:21.860067223 (296h50m19.456838246s) [noise=true , address=45.91.116.10:4088    , piece_id=UCX4YPV5WXHTNPH466TXDHV5SW77OKR2ITS62UURCP23PJS52SNQ, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:21.860353862 (296h50m19.457124892s) [noise=true , address=45.91.116.13:4156    , piece_id=HJYR3FQR4L5IEWKQXB3VQXX2UUXXAZKX2BRW43UC7HQG7MY6RK2Q, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:21.860943129 (296h50m19.457714141s) [noise=true , address=45.91.116.5:4297     , piece_id=FQ2FDGMNT22U66JWRQYPKCTTQ2LXFQ7W2B6W4RSFDJAB6U4GB2CA, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:21.861417130 (296h50m19.458188158s) [noise=true , address=77.90.31.11:4553     , piece_id=VIOPLQQB6UXL3FRE56CPDLIUHNEN6QQ4E3FFXQPXWJM27VSY3H2A, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:21.861463847 (296h50m19.458234871s) [noise=true , address=77.90.31.12:4593     , piece_id=K6TFXKLKVTAYKSBHHQOEXLJCJU4M5L56VL2AI2Y2VNRIU6EJA3TQ, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:21.861895255 (296h50m19.458666278s) [noise=true , address=79.127.219.41:4927   , piece_id=NYZQF7S6I6OTM6VHFNJAKSXVNZFHIATMJ6PNDUM6L35UXVJA624Q, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:21.862126243 (296h50m19.458897272s) [noise=true , address=45.91.116.14:4224    , piece_id=EYNJRKQ3K7IV6DLV63DLXAYWK4FHFOQOMGJ56IGWAT7QFLYNUJ2A, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:21.873279615 (296h50m19.470050638s) [noise=true , address=79.127.219.46:4890   , piece_id=562FBVBOV2SVOQUFCTLWAC376TCVAQQRLHDUNVTUFY7HRKXKSKLQ, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:21.873406573 (296h50m19.4701776s) [noise=true , address=77.90.31.21:4878     , piece_id=DIW3KLODOARSM5CGFYGMRH4PUY72NONBXLDDSUGQZ4BWN7UZMHFQ, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:21.878784593 (296h50m19.47555562s) [noise=true , address=77.90.31.15:4701     , piece_id=C6E5S2O2IQIWGJSEN5GMHASLIXSUSUFKEESBN5VGRRQB67CH5OGQ, seg_pos={0 0}, upload=332478]: Done uploading piece. err: <nil>
Mar 18 19:50:47.590129602 (296h50m45.186900625s) [noise=true , address=145.79.227.23:4548   , piece_id=TFZE2JQ6CXDN4SY5KWVG3SIW6FRDT5EKF6PRRYINAGRQU4BVPOLQ, seg_pos={0 0}, upload=332478]: Done uploading piece. err: ecclient: upload failed (node:19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid, address:145.79.227.23:4548): protocol: rpc: dial tcp 145.79.227.23:4548: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:47.590682130 (296h50m45.187453161s) [noise=true , address=145.79.227.33:4871   , piece_id=SPV5CLP4F7AATHLEIG3Y436GYR4VXYY6WP7C7MQBSOM7FBNEGSLQ, seg_pos={0 0}, upload=332478]: Done uploading piece. err: ecclient: upload failed (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx, address:145.79.227.33:4871): protocol: rpc: dial tcp 145.79.227.33:4871: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:47.590748092 (296h50m45.187519114s) [noise=true , address=145.79.227.21:4477   , piece_id=CA5762SLX257ISX26VRUFNVGBXW55WFQH2YGT4FRV4WVAGVSBDOA, seg_pos={0 0}, upload=332478]: Done uploading piece. err: ecclient: upload failed (node:1QNztqPaSGyZVsQihaj9YjG9C1nzKi1crfSDjDHimYboYAKWZY, address:145.79.227.21:4477): protocol: rpc: dial tcp 145.79.227.21:4477: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:47.590992678 (296h50m45.18776371s) [noise=true , address=145.79.227.13:4803   , piece_id=7P5GGVIV2JXXYLEC4JQ4EK5JJIHRRWBYXT3V4HPHEKC6UUV47CPQ, seg_pos={0 0}, upload=332478]: Done uploading piece. err: ecclient: upload failed (node:12HWjkru3nFUa9hvA27sHqLEmRHSyXTV45phS5kMHKWM163M4H7, address:145.79.227.13:4803): protocol: rpc: dial tcp 145.79.227.13:4803: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:47.592331040 (296h50m45.189102071s) [noise=true , address=145.79.227.10:4406   , piece_id=5G46V2GAVCF5DJY354RHQLNXLDCDUKBZYTCMEJNJI642WFMSHDAQ, seg_pos={0 0}, upload=332478]: Done uploading piece. err: ecclient: upload failed (node:1KrucHjbKjhBZEUGd2p8cmfyCwm6rx4BVwwVhkpgnEv9EQiJRB, address:145.79.227.10:4406): protocol: rpc: dial tcp 145.79.227.10:4406: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:47.592773559 (296h50m45.189544583s) [noise=true , address=145.79.227.50:4377   , piece_id=4DEGGLRDMUUK3WRVM2ELQJVKGNQGF53MOD33B3MJ4JRXQANCV33Q, seg_pos={0 0}, upload=332478]: Done uploading piece. err: ecclient: upload failed (node:126HKpC7sciWFTxNaH5Hjs6BBuh8NRgu8fA4cu4qcK29zfJWg7R, address:145.79.227.50:4377): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:50:47.592803297 (296h50m45.18957431s) [seg_pos={0 0}, upload=332478]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Mar 18 19:50:47.620825462 (296h50m45.217596485s) [upload=332478]: Done uploading segments...
Mar 18 19:50:47.620885016 (296h50m45.217656053s) [upload=332478]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 30.033964902s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [........................................XXXXXX.XX...........]
duration: 
27.505992704s
trace: 
https://jaeger.dev.storj.io/trace/4b4d10a8051ad01b
FAIL (2026-03-18 19:50:46 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 27.506044481s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [.........................................XXX..........X...X.]
duration: 
25.697767718s
trace: 
https://jaeger.dev.storj.io/trace/6a01088813e3d8b7
FAIL (2026-03-18 19:50:33 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
m: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:08.138517471 (296h49m5.735288494s) [upload=332459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:16.284286759 (296h49m13.881057773s) [seg_pos={0 0}, upload=332459]: Begin upload segment...
Mar 18 19:49:16.284352223 (296h49m13.88112325s) [seg_pos={0 0}, upload=332459]: Done begin upload segment.
Mar 18 19:49:16.284395789 (296h49m13.881166818s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284449689 (296h49m13.881220728s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284549974 (296h49m13.881320988s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285144837 (296h49m13.88191587s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285821284 (296h49m13.882592317s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.286556627 (296h49m13.883327669s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287228779 (296h49m13.883999813s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287269957 (296h49m13.884040985s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287437026 (296h49m13.884208049s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287832890 (296h49m13.884603914s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287952922 (296h49m13.884723957s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288418812 (296h49m13.885189842s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288922438 (296h49m13.885693461s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289343580 (296h49m13.886114604s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289780590 (296h49m13.88655162s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.290237004 (296h49m13.887008027s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.292879809 (296h49m13.889650843s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.293664670 (296h49m13.890435693s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.351440712 (296h49m13.948211724s) [upload=332459]: Next returned nil segment
Mar 18 19:49:16.351460639 (296h49m13.948231661s) [upload=332459]: Waiting for error group managing segments...
Mar 18 19:49:16.355941640 (296h49m13.952712664s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.356991929 (296h49m13.953762955s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.361809763 (296h49m13.958580786s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.367502365 (296h49m13.964273396s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.381549888 (296h49m13.97832091s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.387503503 (296h49m13.984274527s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.498139242 (296h49m14.094910266s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.852944491 (296h49m14.449715518s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.878068834 (296h49m14.474839867s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.892446253 (296h49m14.489217282s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.893099142 (296h49m14.48987017s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:17.031110208 (296h49m14.627881232s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:50:08.096628364 (296h50m5.693399398s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw, address:145.79.227.52:4451): protocol: rpc: dial tcp 145.79.227.52:4451: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096712565 (296h50m5.693483599s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:129LRnDm7b4Fo5db7pto8GXYEtxHz9qdPAtQvaYH6gqdkMatQ6g, address:145.79.227.44:4213): protocol: rpc: dial tcp 145.79.227.44:4213: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096943717 (296h50m5.693714752s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1, address:145.79.227.49:4358): protocol: rpc: dial tcp 145.79.227.49:4358: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097022451 (296h50m5.693793484s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12w88UkGu5duYivJ6L6C9iJmTbnB63fDKiUUQprhwM3JshpXTdC, address:145.79.227.3:4163): protocol: rpc: dial tcp 145.79.227.3:4163: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097155433 (296h50m5.693926468s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75, address:145.79.227.13:4822): protocol: rpc: dial tcp 145.79.227.13:4822: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097360007 (296h50m5.694131039s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1pfQ5v1GwHhFTvh5Y7Jpb9qpWhZhFYqWX9PJpLEUzTkqKWcy4x, address:145.79.227.15:4908): protocol: rpc: dial tcp 145.79.227.15:4908: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097462766 (296h50m5.69423378s) [seg_pos={0 0}, upload=332459]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 18 19:50:08.117913456 (296h50m5.714684468s) [upload=332459]: Done uploading segments...
Mar 18 19:50:08.117999321 (296h50m5.714770348s) [upload=332459]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 25.697799063s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
26 out of 60 is failed (threshold=6) [..............................XXXXXXXXX.XXX...XXXXXXXXXXXXXX]
duration: 
5.000662626s
trace: 
https://jaeger.dev.storj.io/trace/2418bcc390fad0c4
FAIL (2026-03-18 19:50:31 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000688167s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [............................................X..........XX..X]
duration: 
1m0.030367975s
trace: 
https://jaeger.dev.storj.io/trace/40b499326665cee7
FAIL (2026-03-18 19:50:22 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 18 19:49:22.100496252 (296h49m19.697267275s) [upload=332463]: Starting upload
Mar 18 19:49:22.100562062 (296h49m19.697333097s) [upload=332463]: Done starting upload
Mar 18 19:49:22.100920922 (296h49m19.697691942s) [upload=332463]: Uploading segments...
Mar 18 19:49:22.101052565 (296h49m19.6978236s) [upload=332463]: Got next segment. Inline: false
Mar 18 19:49:22.101122083 (296h49m19.697893113s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:22.101129030 (296h49m19.697900059s) [upload=332463]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:25.902635706 (296h49m23.499406738s) [seg_pos={0 0}, upload=332463]: Begin upload segment...
Mar 18 19:49:25.902699156 (296h49m23.49947018s) [seg_pos={0 0}, upload=332463]: Done begin upload segment.
Mar 18 19:49:25.902751503 (296h49m23.499522526s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.902763524 (296h49m23.499534558s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.903772480 (296h49m23.500543514s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904336133 (296h49m23.501107164s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.904896440 (296h49m23.501667477s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.905706107 (296h49m23.502477153s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906306716 (296h49m23.503077751s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.906845104 (296h49m23.503616137s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.907488195 (296h49m23.504259226s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.908477653 (296h49m23.505248679s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.910737637 (296h49m23.507508664s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.912589587 (296h49m23.509360619s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.914513704 (296h49m23.511284737s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.916789871 (296h49m23.513560899s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.918547957 (296h49m23.515318984s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.920615295 (296h49m23.517386321s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.922559454 (296h49m23.519330488s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.925302234 (296h49m23.522073257s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Uploading piece...
Mar 18 19:49:25.973039411 (296h49m23.569810434s) [upload=332463]: Next returned nil segment
Mar 18 19:49:25.973052806 (296h49m23.569823829s) [upload=332463]: Waiting for error group managing segments...
Mar 18 19:49:25.995559764 (296h49m23.592330781s) [noise=true , address=77.90.31.11:4581     , piece_id=P2JDFEL2V2UKADRJUFRKYXGQAW2ZQ65VGQCE3ICIZQUZX565IH5A, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.001337339 (296h49m23.598108384s) [noise=true , address=77.90.31.17:4775     , piece_id=KHVRKVINWCHZ4ZFQYYW3YFYQHYUSM4LIPQP7AB7L5ERA6KAPQR7Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.154115776 (296h49m23.750886809s) [noise=true , address=5.231.73.5:4016      , piece_id=NA6FQDLVM6DMD4JT6ZR2UPSK6SS3THCBU6BK5P6ZOEUFMBGHYFHA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.253235656 (296h49m23.850006679s) [noise=true , address=167.17.72.69:4723    , piece_id=HOI6UDYIQ25N2MGLWEY4DS5EQ5BCP5C3GK3RJ656CJZ4VB2ETSTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.493998588 (296h49m24.090769614s) [noise=true , address=79.127.205.234:4185  , piece_id=3OZE6YVHU3SRSWJSXMWLCKWIALRSKJ4UL4PUJMVC6DXS4EPFJRIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.497324258 (296h49m24.094095282s) [noise=true , address=64.49.13.137:4498    , piece_id=CIBHYGP7RZRWSMOU5NVD2FILCMNHCOOPTJHWUVXC6M4O2PA5LQLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.504309786 (296h49m24.101080813s) [noise=true , address=79.127.205.233:4168  , piece_id=3LWUDIIZPVPDGVQFL76P4NLMIR34QK3VAD7DTZZ2D7GO4AIBBKTQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.509531694 (296h49m24.106302708s) [noise=true , address=193.149.164.71:4315  , piece_id=DMR24J3LY6VU7BSXKZ5GGB7PTR2AR7JRIYODUBGB44CUV6XEIJIA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.516397335 (296h49m24.113168361s) [noise=true , address=193.149.164.70:4110  , piece_id=FIFZZLBHFFMLAIZUT5JCAHIJMLVLVGUNC4DF67XSE3XPABIGD7YA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.533102812 (296h49m24.129873852s) [noise=true , address=64.49.13.170:4723    , piece_id=BQVT2JI5CDAWQLUZQQD76DXJRUNM7EVSVDYEKFNINLQTZXRVOTJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.546130691 (296h49m24.142901714s) [noise=true , address=193.149.164.67:4005  , piece_id=TI7LY4ZLLDYHK4OIK63TFHTONJWTYMDGLLWIQMAOBZCLZQXR4QLA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:26.552325489 (296h49m24.149096513s) [noise=true , address=64.49.13.138:4489    , piece_id=HDC4HAR3SZL4BL6QZ25PDMKOWLWED75ETK7VUW75OTJGT3GJES2Q, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:49:28.497314925 (296h49m26.09408595s) [noise=true , address=167.17.72.70:4778    , piece_id=WNA2YVAVKVLLTFYUAEZEYAXCHMDNRKYNRKWVISTCGGAUTCMCPEJQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: <nil>
Mar 18 19:50:22.063196037 (296h50m19.659967069s) [noise=true , address=145.79.227.33:4904   , piece_id=SFWHDAELZM7YKZMRCLWY3WL5JWO33URLNJQJNWXYJ3UYZ3B3QGYQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1dC7mC2Cbxmys7ukEkELyF9Us7F1qtptSP6yDJh1EfjVJ6uqsC, address:145.79.227.33:4904): protocol: rpc: dial tcp 145.79.227.33:4904: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063515331 (296h50m19.660286364s) [noise=true , address=145.79.227.29:4951   , piece_id=QOAXIBCXYVHEAKTH6QTZ5DNEUX2FJ6RQNLPNILPIUGW6LR6KBRWA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:12DH5AoVzQ92aiKUuVJGXecG4yuGZjPJVY6V6cfwQzSYCZAAUNg, address:145.79.227.29:4951): protocol: rpc: dial tcp 145.79.227.29:4951: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063750837 (296h50m19.66052187s) [noise=true , address=145.79.227.12:4772   , piece_id=UAP6J7R5XTMHAQJAHSCCGKBXG73XCMX7NUQ34OMBIHFDDD73GHDQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1BP2yptVJkJzCKenuKzMZ5sBbVbqXcaoVviwKwrnbxodo1pR5w, address:145.79.227.12:4772): protocol: rpc: dial tcp 145.79.227.12:4772: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.063872856 (296h50m19.660643889s) [noise=true , address=145.79.227.49:4365   , piece_id=JN3LS4VKZI2J6DKXNCY34F3M4DKQM5RTNCVMPQSQFLU3HSORWAOA, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:122EX4PNuiRTCG2gbgbaL5dAtD8s5SN7ZesShk7NqUTGCZ3gA2a, address:145.79.227.49:4365): protocol: rpc: dial tcp 145.79.227.49:4365: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064095334 (296h50m19.660866366s) [noise=true , address=145.79.227.34:4939   , piece_id=724NW2MLRW5LLICXVGYQNGZWSOCT34UEVYJAJOG3FJ2SIEXQ5SUQ, seg_pos={0 0}, upload=332463]: Done uploading piece. err: ecclient: upload failed (node:1h7xrPMs5kHtjm7hiB4hfDaZUHFgtJNoMGqdy3HFif2Aned8eu, address:145.79.227.34:4939): protocol: rpc: dial tcp 145.79.227.34:4939: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:22.064168331 (296h50m19.660939355s) [seg_pos={0 0}, upload=332463]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:50:22.091389605 (296h50m19.688160629s) [upload=332463]: Done uploading segments...
Mar 18 19:50:22.091441055 (296h50m19.688212078s) [upload=332463]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.030395119s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
25 out of 60 is failed (threshold=6) [...............................XXXXXXXXX.XXX...XXXXXXXXXXXXX]
duration: 
5.000712402s
trace: 
https://jaeger.dev.storj.io/trace/7ad6f97c4c863049
FAIL (2026-03-18 19:50:16 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000734752s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
20 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXXX]
duration: 
30.026334034s
trace: 
https://jaeger.dev.storj.io/trace/fa1b5babcd59dbd
FAIL (2026-03-18 19:50:11 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
 19:49:45.889402244 (296h49m43.486173268s) [seg_pos={0 0}, upload=332469]: Done begin upload segment.
Mar 18 19:49:45.889430715 (296h49m43.48620174s) [noise=true , address=145.79.227.12:4768   , piece_id=VKU442H77GWS7P6WKABHEYEPF2KGVUJ5QADLCEKHZAHJU2LLXRVQ, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.890448617 (296h49m43.487219651s) [noise=true , address=145.79.227.21:4476   , piece_id=V6EWNWCIIEWCBYL63J6DJUPPPBPRUFRSLIAZQ54OYR3P3E72SNYQ, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.891012517 (296h49m43.487783551s) [noise=true , address=45.91.116.5:4298     , piece_id=OXREEDG6GY3TA63T4QBNAR3AQ6SWG7LIV43LERJMFATW3WZYPYHA, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.892092986 (296h49m43.488864027s) [noise=true , address=145.79.227.36:4522   , piece_id=UEQTNFOMVJ6WEI3IUAZXLJPVSMTWMAFDU7BC7UBYJOKYCBWWBXXA, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.892623659 (296h49m43.489394681s) [noise=true , address=145.79.227.17:4975   , piece_id=FNCMAZ2MGCUBQDFA4Y564QMUQQA7MDYH6EY7VUFIOROPVBLOQ2TA, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.893109355 (296h49m43.48988038s) [noise=true , address=77.90.31.11:4558     , piece_id=ILKD5VEQEEVUVYVLSTZ36DPIVP4JFPAYJ53Z2B4RCO5MHLBY35EQ, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.893568240 (296h49m43.49033927s) [noise=true , address=79.127.219.45:4856   , piece_id=FIAE4AM6ELRTGJYNTSCUPMMBEVE53BFEL3ZDAD55SQRREPBNJZYA, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.893968046 (296h49m43.490739069s) [noise=true , address=145.79.227.15:4879   , piece_id=7XPYJYZSN72EESJ7BUFO7S3LOSGHTOMM2YSJTX6RPSLSVA2TJBNQ, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.894935182 (296h49m43.491706218s) [noise=true , address=145.79.227.20:4438   , piece_id=ULKFDJ2PV7LII52D7VEKTOIWVWH3AFY73NQ4Y36LJPR5J5424M4Q, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.895521135 (296h49m43.492292172s) [noise=true , address=145.79.227.23:4550   , piece_id=QXITAETSNW6TF3VCCOTJ5U73O5FYUNX7KLVEFC3BB2IXA4WTCPQA, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.896063347 (296h49m43.492834361s) [noise=true , address=145.79.227.52:4447   , piece_id=Q6Z5UCZUJPIWESFI54LM75INZLPLAJSETRJT5C4KGDGL4JGPS5EQ, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.896566017 (296h49m43.493337042s) [noise=true , address=77.90.31.21:4880     , piece_id=LG7YNQCKNKRVNX5MBIVZASHD5DGB3JXX4Y44V3KZRNCKOCNXEB5Q, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.897156835 (296h49m43.493927859s) [noise=true , address=145.79.227.10:4405   , piece_id=T7JYFO2JYZFIPNB4J2LUIIJ52HVHG25SCGFFGJ6UHJDINGHYKCJA, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.897681633 (296h49m43.494452664s) [noise=true , address=79.127.219.38:4821   , piece_id=YULIKM4LOGTLVHER5GJNVFEW4SLHNC3XUGL6IIT5Y6WTOMBJ4OIA, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.898258515 (296h49m43.495029548s) [noise=true , address=145.79.227.7:4296    , piece_id=Q5LCXL5EEY7MZKOLG7FOCVMTZXWX23XRMMQF2DAKSMNDHYEA5J2A, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.898784581 (296h49m43.495555613s) [noise=true , address=145.79.227.33:4869   , piece_id=WJIKHEQLWFK76NCBLNHGUOGK6K4G5IICIIFEVY5FYQPXG7EIC7TA, seg_pos={0 0}, upload=332469]: Uploading piece...
Mar 18 19:49:45.998059529 (296h49m43.59483056s) [upload=332469]: Next returned nil segment
Mar 18 19:49:45.998082744 (296h49m43.594853778s) [upload=332469]: Waiting for error group managing segments...
Mar 18 19:49:46.002884221 (296h49m43.599655284s) [noise=true , address=77.90.31.11:4558     , piece_id=ILKD5VEQEEVUVYVLSTZ36DPIVP4JFPAYJ53Z2B4RCO5MHLBY35EQ, seg_pos={0 0}, upload=332469]: Done uploading piece. err: <nil>
Mar 18 19:49:46.003074926 (296h49m43.599845961s) [noise=true , address=45.91.116.5:4298     , piece_id=OXREEDG6GY3TA63T4QBNAR3AQ6SWG7LIV43LERJMFATW3WZYPYHA, seg_pos={0 0}, upload=332469]: Done uploading piece. err: <nil>
Mar 18 19:49:46.004502979 (296h49m43.601273996s) [noise=true , address=77.90.31.21:4880     , piece_id=LG7YNQCKNKRVNX5MBIVZASHD5DGB3JXX4Y44V3KZRNCKOCNXEB5Q, seg_pos={0 0}, upload=332469]: Done uploading piece. err: <nil>
Mar 18 19:49:46.024407743 (296h49m43.621178776s) [noise=true , address=79.127.219.38:4821   , piece_id=YULIKM4LOGTLVHER5GJNVFEW4SLHNC3XUGL6IIT5Y6WTOMBJ4OIA, seg_pos={0 0}, upload=332469]: Done uploading piece. err: <nil>
Mar 18 19:49:46.028007328 (296h49m43.624778355s) [noise=true , address=79.127.219.45:4856   , piece_id=FIAE4AM6ELRTGJYNTSCUPMMBEVE53BFEL3ZDAD55SQRREPBNJZYA, seg_pos={0 0}, upload=332469]: Done uploading piece. err: <nil>
Mar 18 19:50:11.775639257 (296h50m9.372410286s) [noise=true , address=145.79.227.15:4879   , piece_id=7XPYJYZSN72EESJ7BUFO7S3LOSGHTOMM2YSJTX6RPSLSVA2TJBNQ, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:12jH7W99nQ77T67b8WVVqmg9Jqi5QoB1qM5Wcj8WexywAZ7fRNT, address:145.79.227.15:4879): protocol: rpc: dial tcp 145.79.227.15:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.775961052 (296h50m9.372732084s) [noise=true , address=145.79.227.33:4869   , piece_id=WJIKHEQLWFK76NCBLNHGUOGK6K4G5IICIIFEVY5FYQPXG7EIC7TA, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:18CQxjq65r6xVTmNRurSQPzKxj4BoR6cJ8Uq29sTrdh6uXm5sq, address:145.79.227.33:4869): protocol: rpc: dial tcp 145.79.227.33:4869: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.776001368 (296h50m9.372772397s) [noise=true , address=145.79.227.36:4522   , piece_id=UEQTNFOMVJ6WEI3IUAZXLJPVSMTWMAFDU7BC7UBYJOKYCBWWBXXA, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:1zGZe6e37uop4y622fU1GbspMPVEZURS3FbMrf7je6VT9TYGFr, address:145.79.227.36:4522): protocol: rpc: dial tcp 145.79.227.36:4522: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.776272660 (296h50m9.373043692s) [noise=true , address=145.79.227.21:4476   , piece_id=V6EWNWCIIEWCBYL63J6DJUPPPBPRUFRSLIAZQ54OYR3P3E72SNYQ, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:12NKwRvjiEpY7DrbqFGaDHQ8no5YV4cUALnpsvQ8icUPoLvMYen, address:145.79.227.21:4476): protocol: rpc: dial tcp 145.79.227.21:4476: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.776568799 (296h50m9.373339833s) [noise=true , address=145.79.227.10:4405   , piece_id=T7JYFO2JYZFIPNB4J2LUIIJ52HVHG25SCGFFGJ6UHJDINGHYKCJA, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:1MCHYW29ZQjE2fHN8P98hDfNRLsjiVqabF86TXz5nZRBPhbGy4, address:145.79.227.10:4405): protocol: rpc: dial tcp 145.79.227.10:4405: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.776851369 (296h50m9.373622392s) [noise=true , address=145.79.227.17:4975   , piece_id=FNCMAZ2MGCUBQDFA4Y564QMUQQA7MDYH6EY7VUFIOROPVBLOQ2TA, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:12WiUZeNCJk4rzjtyWuKJwGcZATaYLU2QxN27MZE7i45zVpu9dM, address:145.79.227.17:4975): protocol: rpc: dial tcp 145.79.227.17:4975: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.776998071 (296h50m9.373769104s) [noise=true , address=145.79.227.20:4438   , piece_id=ULKFDJ2PV7LII52D7VEKTOIWVWH3AFY73NQ4Y36LJPR5J5424M4Q, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:1GEBfCYivHXYjSXHLmJjrGbgXh4UATzZBDzvx7oLTzeTHum8PT, address:145.79.227.20:4438): protocol: rpc: dial tcp 145.79.227.20:4438: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.777198958 (296h50m9.373969992s) [noise=true , address=145.79.227.12:4768   , piece_id=VKU442H77GWS7P6WKABHEYEPF2KGVUJ5QADLCEKHZAHJU2LLXRVQ, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:12hALeWp4XQEXcmWxXbWU3TTbyLdEF9Pn2h29WwtV5T5jPs3Esq, address:145.79.227.12:4768): protocol: rpc: dial tcp 145.79.227.12:4768: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.777285254 (296h50m9.374056266s) [noise=true , address=145.79.227.7:4296    , piece_id=Q5LCXL5EEY7MZKOLG7FOCVMTZXWX23XRMMQF2DAKSMNDHYEA5J2A, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:12cKhDbA4ptwux2LYNPNAJ7Qh8jECsGWd1KWaK6T6pD38bJWdt1, address:145.79.227.7:4296): protocol: rpc: dial tcp 145.79.227.7:4296: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.777483149 (296h50m9.374254183s) [noise=true , address=145.79.227.23:4550   , piece_id=QXITAETSNW6TF3VCCOTJ5U73O5FYUNX7KLVEFC3BB2IXA4WTCPQA, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:12kn3uD4MCE56bN4MYYsGjDJd2qebgZ6VB6mavL711M8hoU8fbE, address:145.79.227.23:4550): protocol: rpc: dial tcp 145.79.227.23:4550: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.777713080 (296h50m9.374484103s) [noise=true , address=145.79.227.52:4447   , piece_id=Q6Z5UCZUJPIWESFI54LM75INZLPLAJSETRJT5C4KGDGL4JGPS5EQ, seg_pos={0 0}, upload=332469]: Done uploading piece. err: ecclient: upload failed (node:12fqT9xA7kXTG8K9XwTUxL6FXibV35AkPHDK6grKGHg17fk91fP, address:145.79.227.52:4447): protocol: rpc: dial tcp 145.79.227.52:4447: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:11.777745601 (296h50m9.374516614s) [seg_pos={0 0}, upload=332469]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Mar 18 19:50:11.799446276 (296h50m9.3962173s) [upload=332469]: Done uploading segments...
Mar 18 19:50:11.799500297 (296h50m9.39627133s) [upload=332469]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 30.026355511s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [..........................................XXX..........X...X]
duration: 
1m0.023630523s
trace: 
https://jaeger.dev.storj.io/trace/6a01088813e3d8b7
FAIL (2026-03-18 19:50:08 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
m: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:49:08.138517471 (296h49m5.735288494s) [upload=332459]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:49:16.284286759 (296h49m13.881057773s) [seg_pos={0 0}, upload=332459]: Begin upload segment...
Mar 18 19:49:16.284352223 (296h49m13.88112325s) [seg_pos={0 0}, upload=332459]: Done begin upload segment.
Mar 18 19:49:16.284395789 (296h49m13.881166818s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284449689 (296h49m13.881220728s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.284549974 (296h49m13.881320988s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285144837 (296h49m13.88191587s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.285821284 (296h49m13.882592317s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.286556627 (296h49m13.883327669s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287228779 (296h49m13.883999813s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287269957 (296h49m13.884040985s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287437026 (296h49m13.884208049s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287832890 (296h49m13.884603914s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.287952922 (296h49m13.884723957s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288418812 (296h49m13.885189842s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.288922438 (296h49m13.885693461s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289343580 (296h49m13.886114604s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.289780590 (296h49m13.88655162s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.290237004 (296h49m13.887008027s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.292879809 (296h49m13.889650843s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.293664670 (296h49m13.890435693s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Uploading piece...
Mar 18 19:49:16.351440712 (296h49m13.948211724s) [upload=332459]: Next returned nil segment
Mar 18 19:49:16.351460639 (296h49m13.948231661s) [upload=332459]: Waiting for error group managing segments...
Mar 18 19:49:16.355941640 (296h49m13.952712664s) [noise=true , address=77.90.31.21:4894     , piece_id=IQ6775I4HFC5JQVYUCQPXYWPY3X6QRHVXM6IF4JEZRQMMRRWQDUQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.356991929 (296h49m13.953762955s) [noise=true , address=79.127.219.41:4939   , piece_id=WK6HMSTVM7LD2P5MPCKML4MBFZJX2QJWZS6SYPITDKNOLPMRPO6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.361809763 (296h49m13.958580786s) [noise=true , address=45.91.116.5:4308     , piece_id=XRXYA347E22AHAJ4XDENA5EHCV2F43HXL67MTUGRYSU6B3WQBDNQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.367502365 (296h49m13.964273396s) [noise=true , address=77.90.31.14:4685     , piece_id=3KAIZVB2LH6R57CFO55R7BJV7G4MGHFN6M5VTKT3J6LMI5F7PVAA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.381549888 (296h49m13.97832091s) [noise=true , address=79.127.219.45:4864   , piece_id=UXHLRN5HUN3ZRXOZEYAJOS6QUN3PVIXXXED3TS6RPWSHXJ4WKS6Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.387503503 (296h49m13.984274527s) [noise=true , address=77.90.31.18:4817     , piece_id=FMVKZ4Z3YDPWZHTXU3ZTSWXMVUWLKQX7TUWXPQ4LOKBQK64PHF5Q, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.498139242 (296h49m14.094910266s) [noise=true , address=5.231.73.4:4010      , piece_id=LTONWX7UJVP3BPHHKKJUN6PTAR5TVPVKF3CD6NBV2MZWTLUOVQZQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.852944491 (296h49m14.449715518s) [noise=true , address=167.17.72.68:4657    , piece_id=UUIV3ERJSVOJT4TISEHCMR6EQCG6PMZUR6OWGK3ZVV33B33CUZCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.878068834 (296h49m14.474839867s) [noise=true , address=79.127.205.235:4259  , piece_id=N7BGDCO2CR6HLPUWYF35T5OQRWQFEWFG7FPZ6Y33J7FGR5H2ZURQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.892446253 (296h49m14.489217282s) [noise=true , address=193.149.164.68:4051  , piece_id=FCHPX2FRYUVNH4JAAPKI2Y7DSJCUJ5UG3EASXQYB7VEQPNERYUGQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:16.893099142 (296h49m14.48987017s) [noise=true , address=193.149.164.71:4310  , piece_id=BKUA4WC73DSXJMEPCMTXTUD2PVQAAYD44MAGEB3SS3FEDJO7377A, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:49:17.031110208 (296h49m14.627881232s) [noise=true , address=193.149.164.70:4117  , piece_id=PL6FWCO6XQRSVU26FH2KESA26D4Z2PCQVBPBDKBWLBPXHBV5LQVQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: <nil>
Mar 18 19:50:08.096628364 (296h50m5.693399398s) [noise=true , address=145.79.227.52:4451   , piece_id=SBMEAZS5RDQW3RCJP2UU5T7BHF6P7VOICLP5P46YJ5LE2GB65CGA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw, address:145.79.227.52:4451): protocol: rpc: dial tcp 145.79.227.52:4451: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096712565 (296h50m5.693483599s) [noise=true , address=145.79.227.44:4213   , piece_id=MK3BJSFCDOG2MAJYO2BAE2JG62EVEZMCCUATBBBT4QU44GLKK3QA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:129LRnDm7b4Fo5db7pto8GXYEtxHz9qdPAtQvaYH6gqdkMatQ6g, address:145.79.227.44:4213): protocol: rpc: dial tcp 145.79.227.44:4213: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.096943717 (296h50m5.693714752s) [noise=true , address=145.79.227.49:4358   , piece_id=QSE44UR5YBYTJHWGOCBFVQPAUZ3SJV6P5WKBEF3MTFAKVRH2QSHQ, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1, address:145.79.227.49:4358): protocol: rpc: dial tcp 145.79.227.49:4358: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097022451 (296h50m5.693793484s) [noise=true , address=145.79.227.3:4163    , piece_id=3R3QBIJ2XDQZQXJ66RGNZBWZB6V4ERS5RJEZFBTS2LFMQ25G4FLA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12w88UkGu5duYivJ6L6C9iJmTbnB63fDKiUUQprhwM3JshpXTdC, address:145.79.227.3:4163): protocol: rpc: dial tcp 145.79.227.3:4163: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097155433 (296h50m5.693926468s) [noise=true , address=145.79.227.13:4822   , piece_id=Y5GSC3KFFGLK4B3NCXEMOZTAC3ASNGPJJOPOKCUBUJIL75E6T6FA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:12fgLN9DGBGxWfBEePSsk84FTrnKoKWwNgoET3FpotfJxJ28f75, address:145.79.227.13:4822): protocol: rpc: dial tcp 145.79.227.13:4822: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097360007 (296h50m5.694131039s) [noise=true , address=145.79.227.15:4908   , piece_id=LG24OMYBUVPVRBFZL4UUJLPBVNDTVVHQ4HAYTW2PGKHUKZPF2WCA, seg_pos={0 0}, upload=332459]: Done uploading piece. err: ecclient: upload failed (node:1pfQ5v1GwHhFTvh5Y7Jpb9qpWhZhFYqWX9PJpLEUzTkqKWcy4x, address:145.79.227.15:4908): protocol: rpc: dial tcp 145.79.227.15:4908: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:50:08.097462766 (296h50m5.69423378s) [seg_pos={0 0}, upload=332459]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Mar 18 19:50:08.117913456 (296h50m5.714684468s) [upload=332459]: Done uploading segments...
Mar 18 19:50:08.117999321 (296h50m5.714770348s) [upload=332459]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1m0.023658757s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.........................................XXXXXX.XX..........]
duration: 
19.735285714s
trace: 
https://jaeger.dev.storj.io/trace/4b4d10a8051ad01b
FAIL (2026-03-18 19:50:08 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 19.735344421s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
24 out of 60 is failed (threshold=6) [................................XXXXXXXXX.XXX...XXXXXXXXXXXX]
duration: 
5.000657565s
trace: 
https://jaeger.dev.storj.io/trace/1c33b77fe5d725a2
FAIL (2026-03-18 19:49:34 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000682648s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
19 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXXXX]
duration: 
30.024943125s
trace: 
https://jaeger.dev.storj.io/trace/3c3cf8f8f5b700cb
FAIL (2026-03-18 19:49:24 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 6)
======LOGS======
4567 (296h48m52.36365559s) [upload=332456]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:48:58.744786029 (296h48m56.341557061s) [seg_pos={0 0}, upload=332456]: Begin upload segment...
Mar 18 19:48:58.744840074 (296h48m56.341611098s) [seg_pos={0 0}, upload=332456]: Done begin upload segment.
Mar 18 19:48:58.744868180 (296h48m56.341639206s) [noise=true , address=145.79.227.30:4761   , piece_id=ZEL7HDQKDEABZUJPQJ6Y7PZUBPYL6BEJTSIOLQQYL53TC22EW6UQ, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.747294773 (296h48m56.344065799s) [noise=true , address=45.91.116.9:4261     , piece_id=P2UKFBUJ5DVWQNQCUX5JWBVEYFYZ3L5FK3MSB4G6CIFUDFMTGETA, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.747562585 (296h48m56.344333613s) [noise=true , address=77.90.31.21:4877     , piece_id=5U2M5KO7CWMMFAEAUEYSJUE546HX4NONXYPP4NCGR7OMMPSYIBWA, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.748358207 (296h48m56.345129241s) [noise=true , address=145.79.227.15:4875   , piece_id=OCSMHK27F55LHNSXM3O6HRXYN2HHBFYLI2JCIUZHWYOVGSHXZHCA, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.748803941 (296h48m56.345574967s) [noise=true , address=145.79.227.40:4050   , piece_id=3WKARKYLH5XZJQRT5KPXF2GYK7KMNRTLCHLCQHMMJRCFVUIGYSZA, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.748842016 (296h48m56.34561304s) [noise=true , address=77.90.31.13:4627     , piece_id=PS5MOJOHV64PDPLMYSOZ4Q2YUTA4U3MW5RGQDBFEDNIWNNQ47LWA, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.749435493 (296h48m56.346206528s) [noise=true , address=145.79.227.47:4266   , piece_id=IKUQBOZQXTC4B2WFFO424YXI3WW2VMUJO2CT46WETXF4Q3YXDGLQ, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.749681930 (296h48m56.346453043s) [noise=true , address=145.79.227.29:4946   , piece_id=HYM2U3KUAKPLIJTKYA5W2HJMVHXK7TVXGOZLCZUFOZX4IQO6MBXQ, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.750276317 (296h48m56.347047346s) [noise=true , address=145.79.227.21:4474   , piece_id=PFHRVSLEEALN2EXL3RCTJCPF7HSN6KVSL6JH2F2F5JLG4TVJMLOQ, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.750809177 (296h48m56.347580285s) [noise=true , address=145.79.227.23:4551   , piece_id=OYSQGTV7FW5ZCL5PY7N34ILG5IU6AEVZS26AONIX6QPKOOC735QA, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.750923521 (296h48m56.347694546s) [noise=true , address=45.91.116.11:4117    , piece_id=QNYMKC3VAVXXMINDIRX4CQTOCFJM3PPFLUCCSRWHFDGB26I4M24Q, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.751809394 (296h48m56.348580427s) [noise=true , address=145.79.227.5:4224    , piece_id=E2A26ZRAFZTNGREI35ZJ4HCVNG7JJPJUJNGUDQG4E6QPN5B62GSA, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.751834071 (296h48m56.348605093s) [noise=true , address=45.91.116.13:4188    , piece_id=2Z7VOHTNKKIYN7CL3XCJC3PHD2GSBXZHV5E2QKZTVACY7WOO4RTA, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.752472465 (296h48m56.349243497s) [noise=true , address=145.79.227.35:4481   , piece_id=4RMTAJZ7DTK6JKYKTLUIVRSKW7SQYDRCWQQABOQQW25KHAGFKBBQ, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.752745292 (296h48m56.349516345s) [noise=true , address=45.91.116.12:4227    , piece_id=EG7QPRKQLOZ4I4JCYRCX3WBSYBWZV5XDB3HYQPQCF4JOA74RO4NQ, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.753190858 (296h48m56.34996189s) [noise=true , address=145.79.227.18:4011   , piece_id=YLUW4QGKKUEYHC4JKMNZYLRHKN5BOEGBL2OI6XOGD3TSI72RV7TA, seg_pos={0 0}, upload=332456]: Uploading piece...
Mar 18 19:48:58.816888514 (296h48m56.413659526s) [upload=332456]: Next returned nil segment
Mar 18 19:48:58.816925730 (296h48m56.413696752s) [upload=332456]: Waiting for error group managing segments...
Mar 18 19:48:58.820364628 (296h48m56.417135661s) [noise=true , address=45.91.116.13:4188    , piece_id=2Z7VOHTNKKIYN7CL3XCJC3PHD2GSBXZHV5E2QKZTVACY7WOO4RTA, seg_pos={0 0}, upload=332456]: Done uploading piece. err: <nil>
Mar 18 19:48:58.820636315 (296h48m56.417407325s) [noise=true , address=45.91.116.11:4117    , piece_id=QNYMKC3VAVXXMINDIRX4CQTOCFJM3PPFLUCCSRWHFDGB26I4M24Q, seg_pos={0 0}, upload=332456]: Done uploading piece. err: <nil>
Mar 18 19:48:58.820988544 (296h48m56.417759558s) [noise=true , address=45.91.116.12:4227    , piece_id=EG7QPRKQLOZ4I4JCYRCX3WBSYBWZV5XDB3HYQPQCF4JOA74RO4NQ, seg_pos={0 0}, upload=332456]: Done uploading piece. err: <nil>
Mar 18 19:48:58.821084334 (296h48m56.417855358s) [noise=true , address=77.90.31.21:4877     , piece_id=5U2M5KO7CWMMFAEAUEYSJUE546HX4NONXYPP4NCGR7OMMPSYIBWA, seg_pos={0 0}, upload=332456]: Done uploading piece. err: <nil>
Mar 18 19:48:58.821552603 (296h48m56.418323616s) [noise=true , address=45.91.116.9:4261     , piece_id=P2UKFBUJ5DVWQNQCUX5JWBVEYFYZ3L5FK3MSB4G6CIFUDFMTGETA, seg_pos={0 0}, upload=332456]: Done uploading piece. err: <nil>
Mar 18 19:48:58.822528395 (296h48m56.419299421s) [noise=true , address=77.90.31.13:4627     , piece_id=PS5MOJOHV64PDPLMYSOZ4Q2YUTA4U3MW5RGQDBFEDNIWNNQ47LWA, seg_pos={0 0}, upload=332456]: Done uploading piece. err: <nil>
Mar 18 19:49:24.733977102 (296h49m22.330748135s) [noise=true , address=145.79.227.40:4050   , piece_id=3WKARKYLH5XZJQRT5KPXF2GYK7KMNRTLCHLCQHMMJRCFVUIGYSZA, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:12Vw9PtVFLQPpm2uGV55tCoK7VfopaBU4EcWNBUyqhNeJjgjG64, address:145.79.227.40:4050): protocol: rpc: dial tcp 145.79.227.40:4050: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.734701572 (296h49m22.331472604s) [noise=true , address=145.79.227.18:4011   , piece_id=YLUW4QGKKUEYHC4JKMNZYLRHKN5BOEGBL2OI6XOGD3TSI72RV7TA, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:12J8J47emDh4p115m69EqUYroi9GgruC3y8gmv2xVULVJSvFYYP, address:145.79.227.18:4011): protocol: rpc: dial tcp 145.79.227.18:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.735721144 (296h49m22.332492178s) [noise=true , address=145.79.227.47:4266   , piece_id=IKUQBOZQXTC4B2WFFO424YXI3WW2VMUJO2CT46WETXF4Q3YXDGLQ, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:1uzGTks5tffchQBGQK23fnWZXMfrsTHh4Zqs9UGwnWUmnQghEW, address:145.79.227.47:4266): protocol: rpc: dial tcp 145.79.227.47:4266: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.735816859 (296h49m22.332587891s) [noise=true , address=145.79.227.30:4761   , piece_id=ZEL7HDQKDEABZUJPQJ6Y7PZUBPYL6BEJTSIOLQQYL53TC22EW6UQ, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:12aik37v1FXxLLPx5EoA5EWszHVsRUz7kAriBYUbWEtN15555xE, address:145.79.227.30:4761): protocol: rpc: dial tcp 145.79.227.30:4761: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.736102711 (296h49m22.332873745s) [noise=true , address=145.79.227.5:4224    , piece_id=E2A26ZRAFZTNGREI35ZJ4HCVNG7JJPJUJNGUDQG4E6QPN5B62GSA, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:128nLffK44ioiTpjWjAm2vHFTLouLZdw7BijqBAbsdjo99kPYNo, address:145.79.227.5:4224): protocol: rpc: dial tcp 145.79.227.5:4224: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.736372670 (296h49m22.333143693s) [noise=true , address=145.79.227.23:4551   , piece_id=OYSQGTV7FW5ZCL5PY7N34ILG5IU6AEVZS26AONIX6QPKOOC735QA, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:12vR5WRMGoYyzYDZzwELFw6kLG6vtKsUeFM9kUhgZDLGKB6vcXs, address:145.79.227.23:4551): protocol: rpc: dial tcp 145.79.227.23:4551: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.736515988 (296h49m22.333287021s) [noise=true , address=145.79.227.35:4481   , piece_id=4RMTAJZ7DTK6JKYKTLUIVRSKW7SQYDRCWQQABOQQW25KHAGFKBBQ, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:12bRK8WWmAnWUwzCfHu8JtZgrruYSJCvhnsYTKcaLccJcv5RQjp, address:145.79.227.35:4481): protocol: rpc: dial tcp 145.79.227.35:4481: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.736707642 (296h49m22.333478672s) [noise=true , address=145.79.227.21:4474   , piece_id=PFHRVSLEEALN2EXL3RCTJCPF7HSN6KVSL6JH2F2F5JLG4TVJMLOQ, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH, address:145.79.227.21:4474): protocol: rpc: dial tcp 145.79.227.21:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.736868496 (296h49m22.333639531s) [noise=true , address=145.79.227.15:4875   , piece_id=OCSMHK27F55LHNSXM3O6HRXYN2HHBFYLI2JCIUZHWYOVGSHXZHCA, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2, address:145.79.227.15:4875): protocol: rpc: dial tcp 145.79.227.15:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.737204482 (296h49m22.333975506s) [noise=true , address=145.79.227.29:4946   , piece_id=HYM2U3KUAKPLIJTKYA5W2HJMVHXK7TVXGOZLCZUFOZX4IQO6MBXQ, seg_pos={0 0}, upload=332456]: Done uploading piece. err: ecclient: upload failed (node:12v9Q7aigjWPNXyshHmQt9YKrDu5af1vd1TxkDeHeKixSrWgrLX, address:145.79.227.29:4946): protocol: rpc: dial tcp 145.79.227.29:4946: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:49:24.737236055 (296h49m22.33400707s) [seg_pos={0 0}, upload=332456]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil>
Mar 18 19:49:24.756170091 (296h49m22.352941118s) [upload=332456]: Done uploading segments...
Mar 18 19:49:24.756213640 (296h49m22.352984668s) [upload=332456]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6)
Duration: 30.024968739s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
23 out of 60 is failed (threshold=6) [.................................XXXXXXXXX.XXX...XXXXXXXXXXX]
duration: 
5.000970828s
trace: 
https://jaeger.dev.storj.io/trace/39a61e13906e166b
FAIL (2026-03-18 19:49:07 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001013715s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [..........................................XXXXXX.XX.........]
duration: 
11.883312067s
trace: 
https://jaeger.dev.storj.io/trace/4b4d10a8051ad01b
FAIL (2026-03-18 19:48:48 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 11.883338213s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
18 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXXX]
duration: 
30.026641292s
trace: 
https://jaeger.dev.storj.io/trace/7cdcc4b4976b80a9
FAIL (2026-03-18 19:48:38 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 10)
======LOGS======
Mar 18 19:48:08.427796640 (296h48m6.024567664s) [upload=332444]: Starting upload
Mar 18 19:48:08.427912849 (296h48m6.024683872s) [upload=332444]: Done starting upload
Mar 18 19:48:08.428014370 (296h48m6.024785388s) [upload=332444]: Uploading segments...
Mar 18 19:48:08.428537864 (296h48m6.02530889s) [upload=332444]: Got next segment. Inline: false
Mar 18 19:48:08.428620718 (296h48m6.025391751s) [upload=332444]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:48:08.428673332 (296h48m6.025444356s) [upload=332444]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:48:10.396359462 (296h48m7.993130487s) [seg_pos={0 0}, upload=332444]: Begin upload segment...
Mar 18 19:48:10.396431509 (296h48m7.993202538s) [seg_pos={0 0}, upload=332444]: Done begin upload segment.
Mar 18 19:48:10.396506109 (296h48m7.993277141s) [noise=true , address=45.91.116.14:4192    , piece_id=CO2KEDZ7GGO76CS4EMUTFWDMYTQ2LYCO5T3WZGSSXKWTTDW2MRYA, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.397196212 (296h48m7.993967248s) [noise=true , address=77.90.31.11:4554     , piece_id=JTRKJJHXX6HICELEQQVM2QICQQ5RDMUV4TZ73NLQQWN3MTCN47GA, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.397341675 (296h48m7.994112703s) [noise=true , address=77.90.31.13:4626     , piece_id=5ZCH7GTLDQ5Y2P5EOAIFSOYTTTRNOT2K4YMJUWPNVXVDOMHZCWKQ, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.397800848 (296h48m7.994571874s) [noise=true , address=45.91.116.13:4154    , piece_id=OMN7ZZ3XQK76FOJVO577JDC2L5OPWRJD7CVRVYJB4VYWQ6RAW37Q, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.397833151 (296h48m7.994604178s) [noise=true , address=145.79.227.50:4378   , piece_id=FFYLSNWVKVPELIMSYJKFWENOUQWGEDC7YMX5Z6SZO6YMXSUHR4QA, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.398186361 (296h48m7.994957384s) [noise=true , address=77.90.31.12:4590     , piece_id=6HFKLBWDRRFVM2JEOMVL4L66UDTGNIMC7EOR5Y44FBV5ZMAHAZUA, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.398326074 (296h48m7.995097098s) [noise=true , address=45.91.116.9:4264     , piece_id=D24JA5ZIGSWADB7WISKOGUG3IOAO73SMJBDIZS63C4UPR2ENBOZA, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.398621617 (296h48m7.99539264s) [noise=true , address=77.90.31.10:4519     , piece_id=5K5OOG6H4LFE2EFPURWXH7ILW5B5T6BXBCOC2ZMLKL7GY2VSHETA, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.398786882 (296h48m7.995557907s) [noise=true , address=77.90.31.19:4842     , piece_id=W63O5UW4UZUGJGXBCFCMYGUWNOYQM7EW7JKR7RQWHFCZHIQ2RVMA, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.399052015 (296h48m7.995823038s) [noise=true , address=145.79.227.35:4483   , piece_id=CERCELDDIIUOWVHJR7JWLI3YNW4GIPO63HB2I6KKXWUJDZ33TT2Q, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.399244847 (296h48m7.996015869s) [noise=true , address=145.79.227.3:4153    , piece_id=EHX2MQIDSTKVYCZ257SJFBSP5BYEV7WHUNK6SHYS67BW2GX5YWJA, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.399505184 (296h48m7.996276207s) [noise=true , address=145.79.227.45:4234   , piece_id=H262A4T45N5YD53AFD3UCKXSO4PSJIPDJ4MYJB6PVOXXERWC7WVA, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.399794279 (296h48m7.996565301s) [noise=true , address=145.79.227.9:4368    , piece_id=CCRRPOCBMNDTZ65AIZSFF6AZ5Z7HZGCSKZCQFSSZATM22UXHIAPQ, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.399923940 (296h48m7.996694963s) [noise=true , address=45.91.116.7:4019     , piece_id=I7H3RKNXRC3WBWLCU3HRVMGPODMVJHWZWV645AH5XLAFTK7BOSYQ, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.400218759 (296h48m7.996989783s) [noise=true , address=145.79.227.26:4658   , piece_id=KD6NZLNYQWCK65AGOKP63A372FL6LBIUXGXDTT4NDBASCGM6VBJQ, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.400805749 (296h48m7.997576772s) [noise=true , address=79.127.219.38:4817   , piece_id=XAHL36APDEZMJYUYFVAHNINYQRTL5LOJVJWRUZ2EBE5XUZOWWJWQ, seg_pos={0 0}, upload=332444]: Uploading piece...
Mar 18 19:48:10.463887603 (296h48m8.060658626s) [upload=332444]: Next returned nil segment
Mar 18 19:48:10.463902321 (296h48m8.060673334s) [upload=332444]: Waiting for error group managing segments...
Mar 18 19:48:10.469030580 (296h48m8.065801605s) [noise=true , address=45.91.116.14:4192    , piece_id=CO2KEDZ7GGO76CS4EMUTFWDMYTQ2LYCO5T3WZGSSXKWTTDW2MRYA, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:10.469731924 (296h48m8.06650295s) [noise=true , address=45.91.116.13:4154    , piece_id=OMN7ZZ3XQK76FOJVO577JDC2L5OPWRJD7CVRVYJB4VYWQ6RAW37Q, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:10.470122227 (296h48m8.06689325s) [noise=true , address=45.91.116.7:4019     , piece_id=I7H3RKNXRC3WBWLCU3HRVMGPODMVJHWZWV645AH5XLAFTK7BOSYQ, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:10.470344863 (296h48m8.067115893s) [noise=true , address=45.91.116.9:4264     , piece_id=D24JA5ZIGSWADB7WISKOGUG3IOAO73SMJBDIZS63C4UPR2ENBOZA, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:10.471419287 (296h48m8.068190301s) [noise=true , address=79.127.219.38:4817   , piece_id=XAHL36APDEZMJYUYFVAHNINYQRTL5LOJVJWRUZ2EBE5XUZOWWJWQ, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:10.482035353 (296h48m8.078806366s) [noise=true , address=77.90.31.12:4590     , piece_id=6HFKLBWDRRFVM2JEOMVL4L66UDTGNIMC7EOR5Y44FBV5ZMAHAZUA, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:10.488407612 (296h48m8.085178627s) [noise=true , address=77.90.31.11:4554     , piece_id=JTRKJJHXX6HICELEQQVM2QICQQ5RDMUV4TZ73NLQQWN3MTCN47GA, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:10.490000526 (296h48m8.086771549s) [noise=true , address=77.90.31.13:4626     , piece_id=5ZCH7GTLDQ5Y2P5EOAIFSOYTTTRNOT2K4YMJUWPNVXVDOMHZCWKQ, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:10.492766188 (296h48m8.089537214s) [noise=true , address=77.90.31.10:4519     , piece_id=5K5OOG6H4LFE2EFPURWXH7ILW5B5T6BXBCOC2ZMLKL7GY2VSHETA, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:10.511864650 (296h48m8.108635676s) [noise=true , address=77.90.31.19:4842     , piece_id=W63O5UW4UZUGJGXBCFCMYGUWNOYQM7EW7JKR7RQWHFCZHIQ2RVMA, seg_pos={0 0}, upload=332444]: Done uploading piece. err: <nil>
Mar 18 19:48:38.395525099 (296h48m35.992296129s) [noise=true , address=145.79.227.3:4153    , piece_id=EHX2MQIDSTKVYCZ257SJFBSP5BYEV7WHUNK6SHYS67BW2GX5YWJA, seg_pos={0 0}, upload=332444]: Done uploading piece. err: ecclient: upload failed (node:124myE1wFhvjA5paJy5tr2hRe8jZCoEdbJLdBwvss1ZnT4GvtZv, address:145.79.227.3:4153): protocol: rpc: dial tcp 145.79.227.3:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:48:38.395611643 (296h48m35.992382668s) [noise=true , address=145.79.227.26:4658   , piece_id=KD6NZLNYQWCK65AGOKP63A372FL6LBIUXGXDTT4NDBASCGM6VBJQ, seg_pos={0 0}, upload=332444]: Done uploading piece. err: ecclient: upload failed (node:1gcSHRechDzTDwivRoAwNFfNj5Zjqvi6oJwVqzbCQinwgWtpPr, address:145.79.227.26:4658): protocol: rpc: dial tcp 145.79.227.26:4658: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:48:38.395716308 (296h48m35.992487331s) [noise=true , address=145.79.227.45:4234   , piece_id=H262A4T45N5YD53AFD3UCKXSO4PSJIPDJ4MYJB6PVOXXERWC7WVA, seg_pos={0 0}, upload=332444]: Done uploading piece. err: ecclient: upload failed (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy, address:145.79.227.45:4234): protocol: rpc: dial tcp 145.79.227.45:4234: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:48:38.395775244 (296h48m35.99254627s) [noise=true , address=145.79.227.35:4483   , piece_id=CERCELDDIIUOWVHJR7JWLI3YNW4GIPO63HB2I6KKXWUJDZ33TT2Q, seg_pos={0 0}, upload=332444]: Done uploading piece. err: ecclient: upload failed (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY, address:145.79.227.35:4483): protocol: rpc: dial tcp 145.79.227.35:4483: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:48:38.395834571 (296h48m35.992605603s) [noise=true , address=145.79.227.50:4378   , piece_id=FFYLSNWVKVPELIMSYJKFWENOUQWGEDC7YMX5Z6SZO6YMXSUHR4QA, seg_pos={0 0}, upload=332444]: Done uploading piece. err: ecclient: upload failed (node:1DcpXz1fKrWhdPxTpGUFmydMUuzMQpNFMgGB75BAVrjdMiSkhW, address:145.79.227.50:4378): protocol: rpc: dial tcp 145.79.227.50:4378: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:48:38.395897726 (296h48m35.992668753s) [noise=true , address=145.79.227.9:4368    , piece_id=CCRRPOCBMNDTZ65AIZSFF6AZ5Z7HZGCSKZCQFSSZATM22UXHIAPQ, seg_pos={0 0}, upload=332444]: Done uploading piece. err: ecclient: upload failed (node:12ByhoW6Effjs8acfsvdF1xzDwBVqggsBK53oRZ8bYhEYYPChKz, address:145.79.227.9:4368): protocol: rpc: dial tcp 145.79.227.9:4368: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:48:38.395926941 (296h48m35.992697956s) [seg_pos={0 0}, upload=332444]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil>
Mar 18 19:48:38.419645107 (296h48m36.01641613s) [upload=332444]: Done uploading segments...
Mar 18 19:48:38.419695726 (296h48m36.016466748s) [upload=332444]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10)
Duration: 30.026663482s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
22 out of 60 is failed (threshold=6) [..................................XXXXXXXXX.XXX...XXXXXXXXXX]
duration: 
5.001971112s
trace: 
https://jaeger.dev.storj.io/trace/232abedbfd6e4b38
FAIL (2026-03-18 19:48:37 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001995015s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [.............................................X..........XX..]
duration: 
15.082922994s
trace: 
https://jaeger.dev.storj.io/trace/5523a20bc980b101
FAIL (2026-03-18 19:48:22 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 18 19:45:47.783818234 (296h45m45.380589258s) [upload=332400]: Starting upload
Mar 18 19:45:47.783867100 (296h45m45.380638128s) [upload=332400]: Done starting upload
Mar 18 19:45:47.784058237 (296h45m45.380829252s) [upload=332400]: Uploading segments...
Mar 18 19:45:47.784217822 (296h45m45.380988839s) [upload=332400]: Got next segment. Inline: false
Mar 18 19:45:47.784277791 (296h45m45.381048816s) [upload=332400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:45:47.784283676 (296h45m45.381054699s) [upload=332400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:45:53.718718928 (296h45m51.315489941s) [seg_pos={0 0}, upload=332400]: Begin upload segment...
Mar 18 19:45:53.718787653 (296h45m51.315558666s) [seg_pos={0 0}, upload=332400]: Done begin upload segment.
Mar 18 19:45:53.718819149 (296h45m51.315590179s) [noise=true , address=77.90.31.21:4891     , piece_id=6AUH3CDUL3E2CSXCEH4HFQYHJVWU2ZG425G7QRHP7NT5BFH2YADQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.719160161 (296h45m51.315931174s) [noise=true , address=77.90.31.19:4869     , piece_id=5TMZ4LGJMKESRICI7O3Y2OD3KCJTPUTKKN3TY63777QVI3ZV4X5Q, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.719764263 (296h45m51.316535289s) [noise=true , address=193.149.164.70:4106  , piece_id=55GLTT7UR7JXSD62YX56DWFJREAJW7DAQIHPLVLAXGJ7WANRSISQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720194880 (296h45m51.316965904s) [noise=true , address=193.149.164.71:4298  , piece_id=42JKRNQZILCBQNMHTX7QQQA2DYL5OZYERPZIOTDWSUPHHBFH5G3A, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720544743 (296h45m51.317315768s) [noise=true , address=77.90.31.18:4836     , piece_id=JDDWWNJYDZ6T6HJVZYPNU6KQG4ZAB7QMYZ62PMKGZLW2Q7M3KKKA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720887823 (296h45m51.317658847s) [noise=true , address=193.149.164.69:4092  , piece_id=SZSYSTBUECV6VKZK6EVY4VFX4WFZ3ETGC3Z74CBEHKM5CAR66KCA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720968422 (296h45m51.317739453s) [noise=true , address=167.17.72.71:4811    , piece_id=VPTCMDGBAHYL7SLP3MFJAQEDFISJUOHHX6Q47KMORGGV222U3TFA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721219044 (296h45m51.31799007s) [noise=true , address=45.91.116.7:4039     , piece_id=RBOT6ELM2Q2QLUTNXTKKBHCLLCW36YEKQSJTTYKDDWENLDNMK3PQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721570459 (296h45m51.3183415s) [noise=true , address=5.231.73.3:4035      , piece_id=KVMQREYDNSATBYYL4TUZT3GCKBE3ETYL6VGKLHF6UY4NBK7IKLBA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721602095 (296h45m51.318373127s) [noise=true , address=79.127.219.38:4852   , piece_id=7CKIYDCMA5MVSQLXB5HMGVAQ5WB424E6FLGR5FU5FK327IT2UF6A, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721986658 (296h45m51.318757688s) [noise=true , address=45.91.116.9:4275     , piece_id=BV774XRSJDSFHQNXAG6OUHXNWKYS4QGR5O32EAQGTJ7NKP5GTLNA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722198475 (296h45m51.318969505s) [noise=true , address=145.79.227.39:4019   , piece_id=TQPAWK7HNSHZFXJACKX7GY5HLKFTMIHM6UEUQDWNPXTCXRD474JQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722398638 (296h45m51.319169663s) [noise=true , address=79.127.219.45:4877   , piece_id=35BGI5RC5WY2MCDXUG5G2ZNJDFXVIVJMVTA2GJLNDO56BIJICNUQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722749083 (296h45m51.319520106s) [noise=true , address=145.79.227.33:4899   , piece_id=ICWNN3O7JCFXX6LZSEYPTO2BXGCCL6HII7L65HIUJPVP4JTGLA2Q, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722769687 (296h45m51.31954072s) [noise=true , address=145.79.227.43:4164   , piece_id=ALX5HWAFWYH4VTW2X44QJ6GRIEXARB6WT2EGZKNYDVZ2D7HRLGXA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.723491136 (296h45m51.320262173s) [noise=true , address=145.79.227.36:4548   , piece_id=AEJ7VUY5PT3EMWAPYH5QWEVZZR5KFTSXAKYGEGP7OMP77UKV5APA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.724120874 (296h45m51.32089191s) [noise=true , address=145.79.227.47:4271   , piece_id=FUSS3WBGHZ4OA7LXH5RHFVBAA6WXDT4CEW32XEQUVLRDBIUUPHCA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.724738220 (296h45m51.321509254s) [noise=true , address=167.17.72.69:4744    , piece_id=L6YR6XSULEAGDS4J3VKRF3MTPMO4FTK2DSNQE5LZMRP5TNIU7IFA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.790526416 (296h45m51.387297444s) [upload=332400]: Next returned nil segment
Mar 18 19:45:53.790550359 (296h45m51.387321382s) [upload=332400]: Waiting for error group managing segments...
Mar 18 19:45:53.798488443 (296h45m51.395259471s) [noise=true , address=79.127.219.38:4852   , piece_id=7CKIYDCMA5MVSQLXB5HMGVAQ5WB424E6FLGR5FU5FK327IT2UF6A, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.802946429 (296h45m51.399717462s) [noise=true , address=45.91.116.7:4039     , piece_id=RBOT6ELM2Q2QLUTNXTKKBHCLLCW36YEKQSJTTYKDDWENLDNMK3PQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.803155500 (296h45m51.399926534s) [noise=true , address=45.91.116.9:4275     , piece_id=BV774XRSJDSFHQNXAG6OUHXNWKYS4QGR5O32EAQGTJ7NKP5GTLNA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.811586493 (296h45m51.408357516s) [noise=true , address=77.90.31.21:4891     , piece_id=6AUH3CDUL3E2CSXCEH4HFQYHJVWU2ZG425G7QRHP7NT5BFH2YADQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.825088508 (296h45m51.42185952s) [noise=true , address=77.90.31.18:4836     , piece_id=JDDWWNJYDZ6T6HJVZYPNU6KQG4ZAB7QMYZ62PMKGZLW2Q7M3KKKA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.831222274 (296h45m51.427993297s) [noise=true , address=77.90.31.19:4869     , piece_id=5TMZ4LGJMKESRICI7O3Y2OD3KCJTPUTKKN3TY63777QVI3ZV4X5Q, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.950311914 (296h45m51.547082938s) [noise=true , address=5.231.73.3:4035      , piece_id=KVMQREYDNSATBYYL4TUZT3GCKBE3ETYL6VGKLHF6UY4NBK7IKLBA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.076237110 (296h45m51.673008123s) [noise=true , address=167.17.72.69:4744    , piece_id=L6YR6XSULEAGDS4J3VKRF3MTPMO4FTK2DSNQE5LZMRP5TNIU7IFA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.255654117 (296h45m51.852425141s) [noise=true , address=79.127.219.45:4877   , piece_id=35BGI5RC5WY2MCDXUG5G2ZNJDFXVIVJMVTA2GJLNDO56BIJICNUQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.315125295 (296h45m51.911896307s) [noise=true , address=193.149.164.71:4298  , piece_id=42JKRNQZILCBQNMHTX7QQQA2DYL5OZYERPZIOTDWSUPHHBFH5G3A, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.328922853 (296h45m51.925693876s) [noise=true , address=193.149.164.70:4106  , piece_id=55GLTT7UR7JXSD62YX56DWFJREAJW7DAQIHPLVLAXGJ7WANRSISQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.341857790 (296h45m51.938628803s) [noise=true , address=193.149.164.69:4092  , piece_id=SZSYSTBUECV6VKZK6EVY4VFX4WFZ3ETGC3Z74CBEHKM5CAR66KCA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.730608194 (296h45m52.327379208s) [noise=true , address=167.17.72.71:4811    , piece_id=VPTCMDGBAHYL7SLP3MFJAQEDFISJUOHHX6Q47KMORGGV222U3TFA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:46:47.734237495 (296h46m45.331008534s) [noise=true , address=145.79.227.39:4019   , piece_id=TQPAWK7HNSHZFXJACKX7GY5HLKFTMIHM6UEUQDWNPXTCXRD474JQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:1ztmvXKmY6hicHZD7iejpcJCKFEhLwemtaYChAp8Po85TRQvGo, address:145.79.227.39:4019): protocol: rpc: dial tcp 145.79.227.39:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.734544842 (296h46m45.331315874s) [noise=true , address=145.79.227.43:4164   , piece_id=ALX5HWAFWYH4VTW2X44QJ6GRIEXARB6WT2EGZKNYDVZ2D7HRLGXA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:1gUXWffNccBoXWftiMWHHSTeEpA5zrd2cHz4uXX5j75GeEK9s2, address:145.79.227.43:4164): protocol: rpc: dial tcp 145.79.227.43:4164: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.734855639 (296h46m45.331626668s) [noise=true , address=145.79.227.33:4899   , piece_id=ICWNN3O7JCFXX6LZSEYPTO2BXGCCL6HII7L65HIUJPVP4JTGLA2Q, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw, address:145.79.227.33:4899): protocol: rpc: dial tcp 145.79.227.33:4899: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.735109238 (296h46m45.33188027s) [noise=true , address=145.79.227.36:4548   , piece_id=AEJ7VUY5PT3EMWAPYH5QWEVZZR5KFTSXAKYGEGP7OMP77UKV5APA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT, address:145.79.227.36:4548): protocol: rpc: dial tcp 145.79.227.36:4548: i/o timeout; conn closed: op
Mar 18 19:46:47.735331971 (296h46m45.332102985s) [noise=true , address=145.79.227.47:4271   , piece_id=FUSS3WBGHZ4OA7LXH5RHFVBAA6WXDT4CEW32XEQUVLRDBIUUPHCA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:12QwLHnMQHafFPYL83gE6wffvzdkvCHwzzVMLBz4KBVdE7ynuf1, address:145.79.227.47:4271): protocol: rpc: dial tcp 145.79.227.47:4271: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.735448827 (296h46m45.33221985s) [seg_pos={0 0}, upload=332400]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:46:56.457707078 (296h46m54.054478111s) [upload=332400]: Done uploading segments...
Mar 18 19:46:56.457798262 (296h46m54.054569296s) [upload=332400]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 15.082948069s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [...........................................XXXXXX.XX........]
duration: 
9.654352096s
trace: 
https://jaeger.dev.storj.io/trace/4b4d10a8051ad01b
FAIL (2026-03-18 19:48:06 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 9.654386509s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [...........................................XXX..........X...]
duration: 
7.033660763s
trace: 
https://jaeger.dev.storj.io/trace/1bf479969b665dd4
FAIL (2026-03-18 19:48:03 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
upload
Mar 18 19:45:55.724413588 (296h45m53.321184616s) [upload=332403]: Uploading segments...
Mar 18 19:45:55.724976725 (296h45m53.321747753s) [upload=332403]: Got next segment. Inline: false
Mar 18 19:45:55.725055562 (296h45m53.32182659s) [upload=332403]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:45:55.725062440 (296h45m53.32183347s) [upload=332403]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:45:55.789537410 (296h45m53.386308434s) [seg_pos={0 0}, upload=332403]: Begin upload segment...
Mar 18 19:45:55.789593684 (296h45m53.386364714s) [seg_pos={0 0}, upload=332403]: Done begin upload segment.
Mar 18 19:45:55.789627617 (296h45m53.386398644s) [noise=true , address=79.127.219.41:4952   , piece_id=GA2QLS5J7XCVEGDKI4Z6WINI2TVR6W4EU2M2EYRZRRD3SVXS2IGQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.789682580 (296h45m53.386453603s) [noise=true , address=145.79.227.32:4842   , piece_id=KBG43B73ULN5RNVJEC4QPYXN2XUQB5AVSI3HZXJZMW3ID6TWMJJA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.790244853 (296h45m53.38701588s) [noise=true , address=45.91.116.13:4162    , piece_id=RT7EUK6JVB2UP3A723UR4HRFEA4Z2GHKH5W4IH3SBOONSS6FWAPQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.790739907 (296h45m53.387510937s) [noise=true , address=145.79.227.36:4524   , piece_id=7PCXCZVEWF5WLFNW5NZ3GZRB2EOY3YCJUMBH2TQHVZOEXFVMKGJA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791134756 (296h45m53.387905781s) [noise=true , address=193.149.164.71:4302  , piece_id=PNWOIFQEIY4WBL3ORLFYR4HAT6CNEPJVG4VZK3FX67BFPQKXKVQA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791272401 (296h45m53.388043424s) [noise=true , address=145.79.227.25:4645   , piece_id=3MMI4Q6W6OBE7GCMBQURI2XH2AVCGS4EHJ4YR62RPLWQSTQXTKAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791656304 (296h45m53.388427327s) [noise=true , address=145.79.227.23:4578   , piece_id=2KCMG54RKOZWTIIVKHNV53OLRQJGKTWL6NXZUWAI7BQ3QECLKYUQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791800576 (296h45m53.388571599s) [noise=true , address=5.231.73.5:4002      , piece_id=HAZJLW6KUVIDKXJGDO7K2H2HYGNEYRLU4LGPGNVCQY6EC74PAXMQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792080702 (296h45m53.388851725s) [noise=true , address=167.17.72.68:4647    , piece_id=XEZKY23SYZHEDLIOH6HNCBKHC3AKSVFQDQSLCBBWYGWBGHRAHAIA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792219916 (296h45m53.388990942s) [noise=true , address=193.149.164.68:4059  , piece_id=HKJ2X5SD36GYMUH3GPCQ6CMLWFHNEIGVICKPLBEDAAZUSOIRLCHQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792479052 (296h45m53.389250076s) [noise=true , address=145.79.227.29:4950   , piece_id=4ADYJ4RC2XGREHG555QTOQ2N7CJEKYO5LP4CZOGWQO76O4WO2GXA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792644922 (296h45m53.389415949s) [noise=true , address=79.127.219.38:4823   , piece_id=B2TSI2CR4MS5RAYRE6OSWPQHBMZWO2AXSXTCBDEM5OQYOMKLXLVQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792897062 (296h45m53.389668086s) [noise=true , address=193.149.164.70:4111  , piece_id=WQDNO6QQFTXHGTCGVPIXT5FDELGW7U6IRV6MFB7SNOSAP56I5OAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.793280967 (296h45m53.39005199s) [noise=true , address=79.127.205.234:4209  , piece_id=KKSPDUNI3Q2UQWUSH4HALIQEA4VNND7YZNW3XYGYRTJH6RAEX4SQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.793656654 (296h45m53.390427678s) [noise=true , address=193.149.164.66:4971  , piece_id=DILXPCN72OF2R37BBWT73BOMQ4IN5GUFGQODDZEWGF76W3TGKP4Q, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794103390 (296h45m53.390874424s) [noise=true , address=167.17.72.69:4712    , piece_id=OLPGFH3D6SOEOUFVFLX2FARU5BLV6KOXQFIHK2J3FDRHAXCY55DA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794560718 (296h45m53.391331753s) [noise=true , address=45.91.116.6:4988     , piece_id=LRFXVYQFVMQAIUJQA3YZ5DQXM6MHGQGRSQ37HMWP6JQRU47OBM6Q, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794727989 (296h45m53.391499022s) [noise=true , address=193.149.164.67:4010  , piece_id=TLCNHMHTVCBQOJM3YJHBWRJ5QL5PA4BBVLFQFVQQPZVSFFW2WIAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.865906622 (296h45m53.462677645s) [upload=332403]: Next returned nil segment
Mar 18 19:45:55.865920940 (296h45m53.462691964s) [upload=332403]: Waiting for error group managing segments...
Mar 18 19:45:55.870616444 (296h45m53.467387466s) [noise=true , address=45.91.116.13:4162    , piece_id=RT7EUK6JVB2UP3A723UR4HRFEA4Z2GHKH5W4IH3SBOONSS6FWAPQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.894544169 (296h45m53.491315192s) [noise=true , address=79.127.219.41:4952   , piece_id=GA2QLS5J7XCVEGDKI4Z6WINI2TVR6W4EU2M2EYRZRRD3SVXS2IGQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.899772071 (296h45m53.496543098s) [noise=true , address=79.127.219.38:4823   , piece_id=B2TSI2CR4MS5RAYRE6OSWPQHBMZWO2AXSXTCBDEM5OQYOMKLXLVQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.904999236 (296h45m53.50177027s) [noise=true , address=45.91.116.6:4988     , piece_id=LRFXVYQFVMQAIUJQA3YZ5DQXM6MHGQGRSQ37HMWP6JQRU47OBM6Q, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.021706933 (296h45m53.618477957s) [noise=true , address=5.231.73.5:4002      , piece_id=HAZJLW6KUVIDKXJGDO7K2H2HYGNEYRLU4LGPGNVCQY6EC74PAXMQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.110307628 (296h45m53.70707864s) [noise=true , address=167.17.72.69:4712    , piece_id=OLPGFH3D6SOEOUFVFLX2FARU5BLV6KOXQFIHK2J3FDRHAXCY55DA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.377699419 (296h45m53.974470452s) [noise=true , address=167.17.72.68:4647    , piece_id=XEZKY23SYZHEDLIOH6HNCBKHC3AKSVFQDQSLCBBWYGWBGHRAHAIA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.382901915 (296h45m53.97967294s) [noise=true , address=79.127.205.234:4209  , piece_id=KKSPDUNI3Q2UQWUSH4HALIQEA4VNND7YZNW3XYGYRTJH6RAEX4SQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.386677188 (296h45m53.983448225s) [noise=true , address=193.149.164.71:4302  , piece_id=PNWOIFQEIY4WBL3ORLFYR4HAT6CNEPJVG4VZK3FX67BFPQKXKVQA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.388553638 (296h45m53.98532466s) [noise=true , address=193.149.164.68:4059  , piece_id=HKJ2X5SD36GYMUH3GPCQ6CMLWFHNEIGVICKPLBEDAAZUSOIRLCHQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.390393833 (296h45m53.987164863s) [noise=true , address=193.149.164.67:4010  , piece_id=TLCNHMHTVCBQOJM3YJHBWRJ5QL5PA4BBVLFQFVQQPZVSFFW2WIAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.403432758 (296h45m54.000203784s) [noise=true , address=193.149.164.70:4111  , piece_id=WQDNO6QQFTXHGTCGVPIXT5FDELGW7U6IRV6MFB7SNOSAP56I5OAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.427114690 (296h45m54.023885721s) [noise=true , address=193.149.164.66:4971  , piece_id=DILXPCN72OF2R37BBWT73BOMQ4IN5GUFGQODDZEWGF76W3TGKP4Q, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:46:55.682258821 (296h46m53.279029844s) [noise=true , address=145.79.227.23:4578   , piece_id=2KCMG54RKOZWTIIVKHNV53OLRQJGKTWL6NXZUWAI7BQ3QECLKYUQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1poqPvwwjWwAAhkJ5WCDavg9oKxbJrf9xktnYA9DB6o9BV1G49, address:145.79.227.23:4578): protocol: rpc: dial tcp 145.79.227.23:4578: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682680668 (296h46m53.279451698s) [noise=true , address=145.79.227.36:4524   , piece_id=7PCXCZVEWF5WLFNW5NZ3GZRB2EOY3YCJUMBH2TQHVZOEXFVMKGJA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1xfbCzjSwFDRrR1gPggeN8tNCLbRRWDVzCJ6mqhZsbVSe8d4s4, address:145.79.227.36:4524): protocol: rpc: dial tcp 145.79.227.36:4524: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682762192 (296h46m53.279533209s) [noise=true , address=145.79.227.29:4950   , piece_id=4ADYJ4RC2XGREHG555QTOQ2N7CJEKYO5LP4CZOGWQO76O4WO2GXA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1Y6fZC1qCRQYMEvW3475SvnaWYCidxcDhch2YA1ZXW5U8fXDZk, address:145.79.227.29:4950): protocol: rpc: dial tcp 145.79.227.29:4950: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682895077 (296h46m53.279666109s) [noise=true , address=145.79.227.25:4645   , piece_id=3MMI4Q6W6OBE7GCMBQURI2XH2AVCGS4EHJ4YR62RPLWQSTQXTKAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:12NPZfT1KXFLcfPTjX8zLQ4gpagKYosJbvCTKu9sK7989hDjTPm, address:145.79.227.25:4645): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:46:55.683203531 (296h46m53.279974563s) [noise=true , address=145.79.227.32:4842   , piece_id=KBG43B73ULN5RNVJEC4QPYXN2XUQB5AVSI3HZXJZMW3ID6TWMJJA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:125yXSpQg4vxVMtduWXbAUqsLRvQ2b2cDBgHi7Z23dz4fvo5Det, address:145.79.227.32:4842): protocol: rpc: dial tcp 145.79.227.32:4842: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.683243691 (296h46m53.280014715s) [seg_pos={0 0}, upload=332403]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:46:55.707909052 (296h46m53.304680079s) [upload=332403]: Done uploading segments...
Mar 18 19:46:55.707973425 (296h46m53.304744453s) [upload=332403]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 7.03368447s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
21 out of 60 is failed (threshold=6) [...................................XXXXXXXXX.XXX...XXXXXXXXX]
duration: 
5.000686744s
trace: 
https://jaeger.dev.storj.io/trace/1e27b94ad7021bca
FAIL (2026-03-18 19:48:01 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000700158s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [............................................XXXXXX.XX.......]
duration: 
911.633564ms
trace: 
https://jaeger.dev.storj.io/trace/4b4d10a8051ad01b
FAIL (2026-03-18 19:47:36 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 911.657877ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
20 out of 60 is failed (threshold=6) [....................................XXXXXXXXX.XXX...XXXXXXXX]
duration: 
5.002125799s
trace: 
https://jaeger.dev.storj.io/trace/3db224ec66656730
FAIL (2026-03-18 19:47:33 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.002149077s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
17 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXXXXXX]
duration: 
30.054759766s
trace: 
https://jaeger.dev.storj.io/trace/c376ef7ba8c8923
FAIL (2026-03-18 19:47:27 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
.814005829 (296h46m55.410776857s) [seg_pos={0 0}, upload=332421]: Done begin upload segment.
Mar 18 19:46:57.814039149 (296h46m55.410810178s) [noise=true , address=45.91.116.4:4937     , piece_id=P6NDSJRBZPZY7FI76Z47DKM3JMI4MHBESWJPYF2TCNDHX6LSOZWA, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.814072416 (296h46m55.410843448s) [noise=true , address=45.91.116.10:4088    , piece_id=AUBCVHAWXLXCOGVECR3UNFN4WDXQKHMWJE6EYW2JLKWH557UODYQ, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.814769936 (296h46m55.411540971s) [noise=true , address=145.79.227.27:4693   , piece_id=QXSE5ZYQM4UJP6SBW5735VRSDLJKEGX7E2HRZXZ547JNH53XADSA, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.815424948 (296h46m55.412195977s) [noise=true , address=45.91.116.9:4264     , piece_id=PG7TLVU5K5G3XQJTUUQIZQUBWCEAPALEMY5J3YV4VTKDOZ22L76A, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.815897228 (296h46m55.412668265s) [noise=true , address=145.79.227.5:4221    , piece_id=FCV57DWLSHUAVP4DGMEJWLJYTZIE6XZVBXTDARFVBJOQE7S7LD3Q, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.816380570 (296h46m55.413151601s) [noise=true , address=145.79.227.38:4981   , piece_id=QP6QO3EAUFJAIWJ56DFSF4FNUBTMOA4M5NTEO4P4EMEGTMONPYBQ, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.816837392 (296h46m55.413608431s) [noise=true , address=145.79.227.39:4016   , piece_id=ABOZB6RI325YTNCEDQU7QCNK2CESVLC6OEX5ZZMRU2TI7K4GHZSQ, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.817269615 (296h46m55.414040649s) [noise=true , address=145.79.227.22:4511   , piece_id=HLXMSAAVTHL6EFVRBCSRHTMYAX4I4J7HYNPYMHU7CYU6AYHHSRUA, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.817728421 (296h46m55.414499452s) [noise=true , address=145.79.227.3:4155    , piece_id=OCACNSDJLZEIWPJQ6UYSQMGTO2P6HRDEIQOCASOHOOG4P4V4JU5Q, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.818175055 (296h46m55.414946089s) [noise=true , address=145.79.227.2:4113    , piece_id=CVUHKNRAOMWTNQNOFNKFDAPQVCAO5LB4HTWLQQDEE2QU4AOMPSVQ, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.820473738 (296h46m55.417244773s) [noise=true , address=145.79.227.45:4232   , piece_id=Z6WKGBCS525SX3NUJIJIXABYRRJSK4GVDQN2GGIH4AGEDY7GKAGQ, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.821051222 (296h46m55.417822256s) [noise=true , address=45.91.116.6:4976     , piece_id=H75WJEBSSODHV6CAHLVS26Q62QZZQE4QFSLPUR2HF335SNS54SVQ, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.821469080 (296h46m55.41824011s) [noise=true , address=77.90.31.13:4630     , piece_id=ZQ3P3AMRSFCKIQJC6HZNNDXT2NZZWDGPIKUJJYJFXVKFLSDNGGQQ, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.821599945 (296h46m55.418370981s) [noise=true , address=145.79.227.37:4566   , piece_id=D65H5F5N5AQV5JGF3A45C4Y5FROJNUFLMB2DHO7TBCZY7QXWNVNQ, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.822567312 (296h46m55.419338347s) [noise=true , address=145.79.227.34:4906   , piece_id=4KTHC7VK5N2PIVOFASXSRFTBC3Y5FDRZZQXVFTSHWVEW7ZS5SWIA, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.823108609 (296h46m55.419879654s) [noise=true , address=145.79.227.51:4409   , piece_id=K6LYVXEIKZHHDGNTIUMXU4FHMMJSP2S2IHAODRPDKFDCKAVPB2QQ, seg_pos={0 0}, upload=332421]: Uploading piece...
Mar 18 19:46:57.903866216 (296h46m55.500637237s) [upload=332421]: Next returned nil segment
Mar 18 19:46:57.903885065 (296h46m55.500656095s) [upload=332421]: Waiting for error group managing segments...
Mar 18 19:46:57.908272500 (296h46m55.505043523s) [noise=true , address=45.91.116.4:4937     , piece_id=P6NDSJRBZPZY7FI76Z47DKM3JMI4MHBESWJPYF2TCNDHX6LSOZWA, seg_pos={0 0}, upload=332421]: Done uploading piece. err: <nil>
Mar 18 19:46:57.910124367 (296h46m55.50689539s) [noise=true , address=45.91.116.9:4264     , piece_id=PG7TLVU5K5G3XQJTUUQIZQUBWCEAPALEMY5J3YV4VTKDOZ22L76A, seg_pos={0 0}, upload=332421]: Done uploading piece. err: <nil>
Mar 18 19:46:57.910545934 (296h46m55.507316957s) [noise=true , address=45.91.116.10:4088    , piece_id=AUBCVHAWXLXCOGVECR3UNFN4WDXQKHMWJE6EYW2JLKWH557UODYQ, seg_pos={0 0}, upload=332421]: Done uploading piece. err: <nil>
Mar 18 19:46:57.910947527 (296h46m55.507718549s) [noise=true , address=45.91.116.6:4976     , piece_id=H75WJEBSSODHV6CAHLVS26Q62QZZQE4QFSLPUR2HF335SNS54SVQ, seg_pos={0 0}, upload=332421]: Done uploading piece. err: <nil>
Mar 18 19:46:57.911615502 (296h46m55.508386525s) [noise=true , address=77.90.31.13:4630     , piece_id=ZQ3P3AMRSFCKIQJC6HZNNDXT2NZZWDGPIKUJJYJFXVKFLSDNGGQQ, seg_pos={0 0}, upload=332421]: Done uploading piece. err: <nil>
Mar 18 19:47:27.756968215 (296h47m25.353739249s) [noise=true , address=145.79.227.39:4016   , piece_id=ABOZB6RI325YTNCEDQU7QCNK2CESVLC6OEX5ZZMRU2TI7K4GHZSQ, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:1jC98jEWn6K8jFHPA9knJeHAkuNEmcS7ThxUvbySDfbq6FmKVR, address:145.79.227.39:4016): protocol: rpc: dial tcp 145.79.227.39:4016: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.756990807 (296h47m25.353761839s) [noise=true , address=145.79.227.51:4409   , piece_id=K6LYVXEIKZHHDGNTIUMXU4FHMMJSP2S2IHAODRPDKFDCKAVPB2QQ, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: rpc: dial tcp 145.79.227.51:4409: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.757263960 (296h47m25.354034994s) [noise=true , address=145.79.227.22:4511   , piece_id=HLXMSAAVTHL6EFVRBCSRHTMYAX4I4J7HYNPYMHU7CYU6AYHHSRUA, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:12AbLS96MKBYqYykQQJbAFHhfcmturggwPPCsNZ4oGzyMNugVfG, address:145.79.227.22:4511): protocol: rpc: dial tcp 145.79.227.22:4511: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.757516848 (296h47m25.354287878s) [noise=true , address=145.79.227.5:4221    , piece_id=FCV57DWLSHUAVP4DGMEJWLJYTZIE6XZVBXTDARFVBJOQE7S7LD3Q, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:145.79.227.5:4221): protocol: rpc: dial tcp 145.79.227.5:4221: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.757550412 (296h47m25.354321445s) [noise=true , address=145.79.227.38:4981   , piece_id=QP6QO3EAUFJAIWJ56DFSF4FNUBTMOA4M5NTEO4P4EMEGTMONPYBQ, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:1u49RC6mHSy43oo9REosyNVdFB3jKk98A6hH4j9qgCQaF5qPSv, address:145.79.227.38:4981): protocol: rpc: dial tcp 145.79.227.38:4981: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.757790218 (296h47m25.35456125s) [noise=true , address=145.79.227.2:4113    , piece_id=CVUHKNRAOMWTNQNOFNKFDAPQVCAO5LB4HTWLQQDEE2QU4AOMPSVQ, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.757864072 (296h47m25.354635105s) [noise=true , address=145.79.227.3:4155    , piece_id=OCACNSDJLZEIWPJQ6UYSQMGTO2P6HRDEIQOCASOHOOG4P4V4JU5Q, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:1yiUBiCEpAs5yDmgVfFGuxgW4R53jzMJugo8Piff3p79EEZdWr, address:145.79.227.3:4155): protocol: rpc: dial tcp 145.79.227.3:4155: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.757949774 (296h47m25.354720799s) [noise=true , address=145.79.227.27:4693   , piece_id=QXSE5ZYQM4UJP6SBW5735VRSDLJKEGX7E2HRZXZ547JNH53XADSA, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:11E39ZZcpnJR43M2RU3Ggb8neyXj6bbSJkANxdJNGuZJiH8c9d, address:145.79.227.27:4693): protocol: rpc: dial tcp 145.79.227.27:4693: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.758108659 (296h47m25.354879692s) [noise=true , address=145.79.227.37:4566   , piece_id=D65H5F5N5AQV5JGF3A45C4Y5FROJNUFLMB2DHO7TBCZY7QXWNVNQ, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: rpc: dial tcp 145.79.227.37:4566: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.758279468 (296h47m25.355050501s) [noise=true , address=145.79.227.45:4232   , piece_id=Z6WKGBCS525SX3NUJIJIXABYRRJSK4GVDQN2GGIH4AGEDY7GKAGQ, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:1knYU6KSZJCmdpXTRHXZmCsRJYfNGGQCLPEPkWkBgUdyvtSgJe, address:145.79.227.45:4232): protocol: rpc: dial tcp 145.79.227.45:4232: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.758530567 (296h47m25.3553016s) [noise=true , address=145.79.227.34:4906   , piece_id=4KTHC7VK5N2PIVOFASXSRFTBC3Y5FDRZZQXVFTSHWVEW7ZS5SWIA, seg_pos={0 0}, upload=332421]: Done uploading piece. err: ecclient: upload failed (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw, address:145.79.227.34:4906): protocol: rpc: dial tcp 145.79.227.34:4906: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:47:27.758569373 (296h47m25.355340388s) [seg_pos={0 0}, upload=332421]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Mar 18 19:47:27.809482951 (296h47m25.406253964s) [upload=332421]: Done uploading segments...
Mar 18 19:47:27.809520377 (296h47m25.406291403s) [upload=332421]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 30.054785812s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [..............................................X..........XX.]
duration: 
29.626102268s
trace: 
https://jaeger.dev.storj.io/trace/5523a20bc980b101
FAIL (2026-03-18 19:47:26 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 18 19:45:47.783818234 (296h45m45.380589258s) [upload=332400]: Starting upload
Mar 18 19:45:47.783867100 (296h45m45.380638128s) [upload=332400]: Done starting upload
Mar 18 19:45:47.784058237 (296h45m45.380829252s) [upload=332400]: Uploading segments...
Mar 18 19:45:47.784217822 (296h45m45.380988839s) [upload=332400]: Got next segment. Inline: false
Mar 18 19:45:47.784277791 (296h45m45.381048816s) [upload=332400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:45:47.784283676 (296h45m45.381054699s) [upload=332400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:45:53.718718928 (296h45m51.315489941s) [seg_pos={0 0}, upload=332400]: Begin upload segment...
Mar 18 19:45:53.718787653 (296h45m51.315558666s) [seg_pos={0 0}, upload=332400]: Done begin upload segment.
Mar 18 19:45:53.718819149 (296h45m51.315590179s) [noise=true , address=77.90.31.21:4891     , piece_id=6AUH3CDUL3E2CSXCEH4HFQYHJVWU2ZG425G7QRHP7NT5BFH2YADQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.719160161 (296h45m51.315931174s) [noise=true , address=77.90.31.19:4869     , piece_id=5TMZ4LGJMKESRICI7O3Y2OD3KCJTPUTKKN3TY63777QVI3ZV4X5Q, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.719764263 (296h45m51.316535289s) [noise=true , address=193.149.164.70:4106  , piece_id=55GLTT7UR7JXSD62YX56DWFJREAJW7DAQIHPLVLAXGJ7WANRSISQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720194880 (296h45m51.316965904s) [noise=true , address=193.149.164.71:4298  , piece_id=42JKRNQZILCBQNMHTX7QQQA2DYL5OZYERPZIOTDWSUPHHBFH5G3A, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720544743 (296h45m51.317315768s) [noise=true , address=77.90.31.18:4836     , piece_id=JDDWWNJYDZ6T6HJVZYPNU6KQG4ZAB7QMYZ62PMKGZLW2Q7M3KKKA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720887823 (296h45m51.317658847s) [noise=true , address=193.149.164.69:4092  , piece_id=SZSYSTBUECV6VKZK6EVY4VFX4WFZ3ETGC3Z74CBEHKM5CAR66KCA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720968422 (296h45m51.317739453s) [noise=true , address=167.17.72.71:4811    , piece_id=VPTCMDGBAHYL7SLP3MFJAQEDFISJUOHHX6Q47KMORGGV222U3TFA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721219044 (296h45m51.31799007s) [noise=true , address=45.91.116.7:4039     , piece_id=RBOT6ELM2Q2QLUTNXTKKBHCLLCW36YEKQSJTTYKDDWENLDNMK3PQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721570459 (296h45m51.3183415s) [noise=true , address=5.231.73.3:4035      , piece_id=KVMQREYDNSATBYYL4TUZT3GCKBE3ETYL6VGKLHF6UY4NBK7IKLBA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721602095 (296h45m51.318373127s) [noise=true , address=79.127.219.38:4852   , piece_id=7CKIYDCMA5MVSQLXB5HMGVAQ5WB424E6FLGR5FU5FK327IT2UF6A, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721986658 (296h45m51.318757688s) [noise=true , address=45.91.116.9:4275     , piece_id=BV774XRSJDSFHQNXAG6OUHXNWKYS4QGR5O32EAQGTJ7NKP5GTLNA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722198475 (296h45m51.318969505s) [noise=true , address=145.79.227.39:4019   , piece_id=TQPAWK7HNSHZFXJACKX7GY5HLKFTMIHM6UEUQDWNPXTCXRD474JQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722398638 (296h45m51.319169663s) [noise=true , address=79.127.219.45:4877   , piece_id=35BGI5RC5WY2MCDXUG5G2ZNJDFXVIVJMVTA2GJLNDO56BIJICNUQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722749083 (296h45m51.319520106s) [noise=true , address=145.79.227.33:4899   , piece_id=ICWNN3O7JCFXX6LZSEYPTO2BXGCCL6HII7L65HIUJPVP4JTGLA2Q, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722769687 (296h45m51.31954072s) [noise=true , address=145.79.227.43:4164   , piece_id=ALX5HWAFWYH4VTW2X44QJ6GRIEXARB6WT2EGZKNYDVZ2D7HRLGXA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.723491136 (296h45m51.320262173s) [noise=true , address=145.79.227.36:4548   , piece_id=AEJ7VUY5PT3EMWAPYH5QWEVZZR5KFTSXAKYGEGP7OMP77UKV5APA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.724120874 (296h45m51.32089191s) [noise=true , address=145.79.227.47:4271   , piece_id=FUSS3WBGHZ4OA7LXH5RHFVBAA6WXDT4CEW32XEQUVLRDBIUUPHCA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.724738220 (296h45m51.321509254s) [noise=true , address=167.17.72.69:4744    , piece_id=L6YR6XSULEAGDS4J3VKRF3MTPMO4FTK2DSNQE5LZMRP5TNIU7IFA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.790526416 (296h45m51.387297444s) [upload=332400]: Next returned nil segment
Mar 18 19:45:53.790550359 (296h45m51.387321382s) [upload=332400]: Waiting for error group managing segments...
Mar 18 19:45:53.798488443 (296h45m51.395259471s) [noise=true , address=79.127.219.38:4852   , piece_id=7CKIYDCMA5MVSQLXB5HMGVAQ5WB424E6FLGR5FU5FK327IT2UF6A, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.802946429 (296h45m51.399717462s) [noise=true , address=45.91.116.7:4039     , piece_id=RBOT6ELM2Q2QLUTNXTKKBHCLLCW36YEKQSJTTYKDDWENLDNMK3PQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.803155500 (296h45m51.399926534s) [noise=true , address=45.91.116.9:4275     , piece_id=BV774XRSJDSFHQNXAG6OUHXNWKYS4QGR5O32EAQGTJ7NKP5GTLNA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.811586493 (296h45m51.408357516s) [noise=true , address=77.90.31.21:4891     , piece_id=6AUH3CDUL3E2CSXCEH4HFQYHJVWU2ZG425G7QRHP7NT5BFH2YADQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.825088508 (296h45m51.42185952s) [noise=true , address=77.90.31.18:4836     , piece_id=JDDWWNJYDZ6T6HJVZYPNU6KQG4ZAB7QMYZ62PMKGZLW2Q7M3KKKA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.831222274 (296h45m51.427993297s) [noise=true , address=77.90.31.19:4869     , piece_id=5TMZ4LGJMKESRICI7O3Y2OD3KCJTPUTKKN3TY63777QVI3ZV4X5Q, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.950311914 (296h45m51.547082938s) [noise=true , address=5.231.73.3:4035      , piece_id=KVMQREYDNSATBYYL4TUZT3GCKBE3ETYL6VGKLHF6UY4NBK7IKLBA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.076237110 (296h45m51.673008123s) [noise=true , address=167.17.72.69:4744    , piece_id=L6YR6XSULEAGDS4J3VKRF3MTPMO4FTK2DSNQE5LZMRP5TNIU7IFA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.255654117 (296h45m51.852425141s) [noise=true , address=79.127.219.45:4877   , piece_id=35BGI5RC5WY2MCDXUG5G2ZNJDFXVIVJMVTA2GJLNDO56BIJICNUQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.315125295 (296h45m51.911896307s) [noise=true , address=193.149.164.71:4298  , piece_id=42JKRNQZILCBQNMHTX7QQQA2DYL5OZYERPZIOTDWSUPHHBFH5G3A, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.328922853 (296h45m51.925693876s) [noise=true , address=193.149.164.70:4106  , piece_id=55GLTT7UR7JXSD62YX56DWFJREAJW7DAQIHPLVLAXGJ7WANRSISQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.341857790 (296h45m51.938628803s) [noise=true , address=193.149.164.69:4092  , piece_id=SZSYSTBUECV6VKZK6EVY4VFX4WFZ3ETGC3Z74CBEHKM5CAR66KCA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.730608194 (296h45m52.327379208s) [noise=true , address=167.17.72.71:4811    , piece_id=VPTCMDGBAHYL7SLP3MFJAQEDFISJUOHHX6Q47KMORGGV222U3TFA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:46:47.734237495 (296h46m45.331008534s) [noise=true , address=145.79.227.39:4019   , piece_id=TQPAWK7HNSHZFXJACKX7GY5HLKFTMIHM6UEUQDWNPXTCXRD474JQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:1ztmvXKmY6hicHZD7iejpcJCKFEhLwemtaYChAp8Po85TRQvGo, address:145.79.227.39:4019): protocol: rpc: dial tcp 145.79.227.39:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.734544842 (296h46m45.331315874s) [noise=true , address=145.79.227.43:4164   , piece_id=ALX5HWAFWYH4VTW2X44QJ6GRIEXARB6WT2EGZKNYDVZ2D7HRLGXA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:1gUXWffNccBoXWftiMWHHSTeEpA5zrd2cHz4uXX5j75GeEK9s2, address:145.79.227.43:4164): protocol: rpc: dial tcp 145.79.227.43:4164: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.734855639 (296h46m45.331626668s) [noise=true , address=145.79.227.33:4899   , piece_id=ICWNN3O7JCFXX6LZSEYPTO2BXGCCL6HII7L65HIUJPVP4JTGLA2Q, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw, address:145.79.227.33:4899): protocol: rpc: dial tcp 145.79.227.33:4899: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.735109238 (296h46m45.33188027s) [noise=true , address=145.79.227.36:4548   , piece_id=AEJ7VUY5PT3EMWAPYH5QWEVZZR5KFTSXAKYGEGP7OMP77UKV5APA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT, address:145.79.227.36:4548): protocol: rpc: dial tcp 145.79.227.36:4548: i/o timeout; conn closed: op
Mar 18 19:46:47.735331971 (296h46m45.332102985s) [noise=true , address=145.79.227.47:4271   , piece_id=FUSS3WBGHZ4OA7LXH5RHFVBAA6WXDT4CEW32XEQUVLRDBIUUPHCA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:12QwLHnMQHafFPYL83gE6wffvzdkvCHwzzVMLBz4KBVdE7ynuf1, address:145.79.227.47:4271): protocol: rpc: dial tcp 145.79.227.47:4271: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.735448827 (296h46m45.33221985s) [seg_pos={0 0}, upload=332400]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:46:56.457707078 (296h46m54.054478111s) [upload=332400]: Done uploading segments...
Mar 18 19:46:56.457798262 (296h46m54.054569296s) [upload=332400]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 29.626123999s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [............................................XXX..........X..]
duration: 
1.346566843s
trace: 
https://jaeger.dev.storj.io/trace/1bf479969b665dd4
FAIL (2026-03-18 19:47:14 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
upload
Mar 18 19:45:55.724413588 (296h45m53.321184616s) [upload=332403]: Uploading segments...
Mar 18 19:45:55.724976725 (296h45m53.321747753s) [upload=332403]: Got next segment. Inline: false
Mar 18 19:45:55.725055562 (296h45m53.32182659s) [upload=332403]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:45:55.725062440 (296h45m53.32183347s) [upload=332403]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:45:55.789537410 (296h45m53.386308434s) [seg_pos={0 0}, upload=332403]: Begin upload segment...
Mar 18 19:45:55.789593684 (296h45m53.386364714s) [seg_pos={0 0}, upload=332403]: Done begin upload segment.
Mar 18 19:45:55.789627617 (296h45m53.386398644s) [noise=true , address=79.127.219.41:4952   , piece_id=GA2QLS5J7XCVEGDKI4Z6WINI2TVR6W4EU2M2EYRZRRD3SVXS2IGQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.789682580 (296h45m53.386453603s) [noise=true , address=145.79.227.32:4842   , piece_id=KBG43B73ULN5RNVJEC4QPYXN2XUQB5AVSI3HZXJZMW3ID6TWMJJA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.790244853 (296h45m53.38701588s) [noise=true , address=45.91.116.13:4162    , piece_id=RT7EUK6JVB2UP3A723UR4HRFEA4Z2GHKH5W4IH3SBOONSS6FWAPQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.790739907 (296h45m53.387510937s) [noise=true , address=145.79.227.36:4524   , piece_id=7PCXCZVEWF5WLFNW5NZ3GZRB2EOY3YCJUMBH2TQHVZOEXFVMKGJA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791134756 (296h45m53.387905781s) [noise=true , address=193.149.164.71:4302  , piece_id=PNWOIFQEIY4WBL3ORLFYR4HAT6CNEPJVG4VZK3FX67BFPQKXKVQA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791272401 (296h45m53.388043424s) [noise=true , address=145.79.227.25:4645   , piece_id=3MMI4Q6W6OBE7GCMBQURI2XH2AVCGS4EHJ4YR62RPLWQSTQXTKAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791656304 (296h45m53.388427327s) [noise=true , address=145.79.227.23:4578   , piece_id=2KCMG54RKOZWTIIVKHNV53OLRQJGKTWL6NXZUWAI7BQ3QECLKYUQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791800576 (296h45m53.388571599s) [noise=true , address=5.231.73.5:4002      , piece_id=HAZJLW6KUVIDKXJGDO7K2H2HYGNEYRLU4LGPGNVCQY6EC74PAXMQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792080702 (296h45m53.388851725s) [noise=true , address=167.17.72.68:4647    , piece_id=XEZKY23SYZHEDLIOH6HNCBKHC3AKSVFQDQSLCBBWYGWBGHRAHAIA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792219916 (296h45m53.388990942s) [noise=true , address=193.149.164.68:4059  , piece_id=HKJ2X5SD36GYMUH3GPCQ6CMLWFHNEIGVICKPLBEDAAZUSOIRLCHQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792479052 (296h45m53.389250076s) [noise=true , address=145.79.227.29:4950   , piece_id=4ADYJ4RC2XGREHG555QTOQ2N7CJEKYO5LP4CZOGWQO76O4WO2GXA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792644922 (296h45m53.389415949s) [noise=true , address=79.127.219.38:4823   , piece_id=B2TSI2CR4MS5RAYRE6OSWPQHBMZWO2AXSXTCBDEM5OQYOMKLXLVQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792897062 (296h45m53.389668086s) [noise=true , address=193.149.164.70:4111  , piece_id=WQDNO6QQFTXHGTCGVPIXT5FDELGW7U6IRV6MFB7SNOSAP56I5OAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.793280967 (296h45m53.39005199s) [noise=true , address=79.127.205.234:4209  , piece_id=KKSPDUNI3Q2UQWUSH4HALIQEA4VNND7YZNW3XYGYRTJH6RAEX4SQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.793656654 (296h45m53.390427678s) [noise=true , address=193.149.164.66:4971  , piece_id=DILXPCN72OF2R37BBWT73BOMQ4IN5GUFGQODDZEWGF76W3TGKP4Q, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794103390 (296h45m53.390874424s) [noise=true , address=167.17.72.69:4712    , piece_id=OLPGFH3D6SOEOUFVFLX2FARU5BLV6KOXQFIHK2J3FDRHAXCY55DA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794560718 (296h45m53.391331753s) [noise=true , address=45.91.116.6:4988     , piece_id=LRFXVYQFVMQAIUJQA3YZ5DQXM6MHGQGRSQ37HMWP6JQRU47OBM6Q, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794727989 (296h45m53.391499022s) [noise=true , address=193.149.164.67:4010  , piece_id=TLCNHMHTVCBQOJM3YJHBWRJ5QL5PA4BBVLFQFVQQPZVSFFW2WIAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.865906622 (296h45m53.462677645s) [upload=332403]: Next returned nil segment
Mar 18 19:45:55.865920940 (296h45m53.462691964s) [upload=332403]: Waiting for error group managing segments...
Mar 18 19:45:55.870616444 (296h45m53.467387466s) [noise=true , address=45.91.116.13:4162    , piece_id=RT7EUK6JVB2UP3A723UR4HRFEA4Z2GHKH5W4IH3SBOONSS6FWAPQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.894544169 (296h45m53.491315192s) [noise=true , address=79.127.219.41:4952   , piece_id=GA2QLS5J7XCVEGDKI4Z6WINI2TVR6W4EU2M2EYRZRRD3SVXS2IGQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.899772071 (296h45m53.496543098s) [noise=true , address=79.127.219.38:4823   , piece_id=B2TSI2CR4MS5RAYRE6OSWPQHBMZWO2AXSXTCBDEM5OQYOMKLXLVQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.904999236 (296h45m53.50177027s) [noise=true , address=45.91.116.6:4988     , piece_id=LRFXVYQFVMQAIUJQA3YZ5DQXM6MHGQGRSQ37HMWP6JQRU47OBM6Q, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.021706933 (296h45m53.618477957s) [noise=true , address=5.231.73.5:4002      , piece_id=HAZJLW6KUVIDKXJGDO7K2H2HYGNEYRLU4LGPGNVCQY6EC74PAXMQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.110307628 (296h45m53.70707864s) [noise=true , address=167.17.72.69:4712    , piece_id=OLPGFH3D6SOEOUFVFLX2FARU5BLV6KOXQFIHK2J3FDRHAXCY55DA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.377699419 (296h45m53.974470452s) [noise=true , address=167.17.72.68:4647    , piece_id=XEZKY23SYZHEDLIOH6HNCBKHC3AKSVFQDQSLCBBWYGWBGHRAHAIA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.382901915 (296h45m53.97967294s) [noise=true , address=79.127.205.234:4209  , piece_id=KKSPDUNI3Q2UQWUSH4HALIQEA4VNND7YZNW3XYGYRTJH6RAEX4SQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.386677188 (296h45m53.983448225s) [noise=true , address=193.149.164.71:4302  , piece_id=PNWOIFQEIY4WBL3ORLFYR4HAT6CNEPJVG4VZK3FX67BFPQKXKVQA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.388553638 (296h45m53.98532466s) [noise=true , address=193.149.164.68:4059  , piece_id=HKJ2X5SD36GYMUH3GPCQ6CMLWFHNEIGVICKPLBEDAAZUSOIRLCHQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.390393833 (296h45m53.987164863s) [noise=true , address=193.149.164.67:4010  , piece_id=TLCNHMHTVCBQOJM3YJHBWRJ5QL5PA4BBVLFQFVQQPZVSFFW2WIAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.403432758 (296h45m54.000203784s) [noise=true , address=193.149.164.70:4111  , piece_id=WQDNO6QQFTXHGTCGVPIXT5FDELGW7U6IRV6MFB7SNOSAP56I5OAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.427114690 (296h45m54.023885721s) [noise=true , address=193.149.164.66:4971  , piece_id=DILXPCN72OF2R37BBWT73BOMQ4IN5GUFGQODDZEWGF76W3TGKP4Q, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:46:55.682258821 (296h46m53.279029844s) [noise=true , address=145.79.227.23:4578   , piece_id=2KCMG54RKOZWTIIVKHNV53OLRQJGKTWL6NXZUWAI7BQ3QECLKYUQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1poqPvwwjWwAAhkJ5WCDavg9oKxbJrf9xktnYA9DB6o9BV1G49, address:145.79.227.23:4578): protocol: rpc: dial tcp 145.79.227.23:4578: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682680668 (296h46m53.279451698s) [noise=true , address=145.79.227.36:4524   , piece_id=7PCXCZVEWF5WLFNW5NZ3GZRB2EOY3YCJUMBH2TQHVZOEXFVMKGJA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1xfbCzjSwFDRrR1gPggeN8tNCLbRRWDVzCJ6mqhZsbVSe8d4s4, address:145.79.227.36:4524): protocol: rpc: dial tcp 145.79.227.36:4524: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682762192 (296h46m53.279533209s) [noise=true , address=145.79.227.29:4950   , piece_id=4ADYJ4RC2XGREHG555QTOQ2N7CJEKYO5LP4CZOGWQO76O4WO2GXA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1Y6fZC1qCRQYMEvW3475SvnaWYCidxcDhch2YA1ZXW5U8fXDZk, address:145.79.227.29:4950): protocol: rpc: dial tcp 145.79.227.29:4950: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682895077 (296h46m53.279666109s) [noise=true , address=145.79.227.25:4645   , piece_id=3MMI4Q6W6OBE7GCMBQURI2XH2AVCGS4EHJ4YR62RPLWQSTQXTKAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:12NPZfT1KXFLcfPTjX8zLQ4gpagKYosJbvCTKu9sK7989hDjTPm, address:145.79.227.25:4645): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:46:55.683203531 (296h46m53.279974563s) [noise=true , address=145.79.227.32:4842   , piece_id=KBG43B73ULN5RNVJEC4QPYXN2XUQB5AVSI3HZXJZMW3ID6TWMJJA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:125yXSpQg4vxVMtduWXbAUqsLRvQ2b2cDBgHi7Z23dz4fvo5Det, address:145.79.227.32:4842): protocol: rpc: dial tcp 145.79.227.32:4842: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.683243691 (296h46m53.280014715s) [seg_pos={0 0}, upload=332403]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:46:55.707909052 (296h46m53.304680079s) [upload=332403]: Done uploading segments...
Mar 18 19:46:55.707973425 (296h46m53.304744453s) [upload=332403]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.346592534s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.............................................XXX..........X.]
duration: 
1.377760387s
trace: 
https://jaeger.dev.storj.io/trace/1bf479969b665dd4
FAIL (2026-03-18 19:46:57 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
upload
Mar 18 19:45:55.724413588 (296h45m53.321184616s) [upload=332403]: Uploading segments...
Mar 18 19:45:55.724976725 (296h45m53.321747753s) [upload=332403]: Got next segment. Inline: false
Mar 18 19:45:55.725055562 (296h45m53.32182659s) [upload=332403]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:45:55.725062440 (296h45m53.32183347s) [upload=332403]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:45:55.789537410 (296h45m53.386308434s) [seg_pos={0 0}, upload=332403]: Begin upload segment...
Mar 18 19:45:55.789593684 (296h45m53.386364714s) [seg_pos={0 0}, upload=332403]: Done begin upload segment.
Mar 18 19:45:55.789627617 (296h45m53.386398644s) [noise=true , address=79.127.219.41:4952   , piece_id=GA2QLS5J7XCVEGDKI4Z6WINI2TVR6W4EU2M2EYRZRRD3SVXS2IGQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.789682580 (296h45m53.386453603s) [noise=true , address=145.79.227.32:4842   , piece_id=KBG43B73ULN5RNVJEC4QPYXN2XUQB5AVSI3HZXJZMW3ID6TWMJJA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.790244853 (296h45m53.38701588s) [noise=true , address=45.91.116.13:4162    , piece_id=RT7EUK6JVB2UP3A723UR4HRFEA4Z2GHKH5W4IH3SBOONSS6FWAPQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.790739907 (296h45m53.387510937s) [noise=true , address=145.79.227.36:4524   , piece_id=7PCXCZVEWF5WLFNW5NZ3GZRB2EOY3YCJUMBH2TQHVZOEXFVMKGJA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791134756 (296h45m53.387905781s) [noise=true , address=193.149.164.71:4302  , piece_id=PNWOIFQEIY4WBL3ORLFYR4HAT6CNEPJVG4VZK3FX67BFPQKXKVQA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791272401 (296h45m53.388043424s) [noise=true , address=145.79.227.25:4645   , piece_id=3MMI4Q6W6OBE7GCMBQURI2XH2AVCGS4EHJ4YR62RPLWQSTQXTKAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791656304 (296h45m53.388427327s) [noise=true , address=145.79.227.23:4578   , piece_id=2KCMG54RKOZWTIIVKHNV53OLRQJGKTWL6NXZUWAI7BQ3QECLKYUQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791800576 (296h45m53.388571599s) [noise=true , address=5.231.73.5:4002      , piece_id=HAZJLW6KUVIDKXJGDO7K2H2HYGNEYRLU4LGPGNVCQY6EC74PAXMQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792080702 (296h45m53.388851725s) [noise=true , address=167.17.72.68:4647    , piece_id=XEZKY23SYZHEDLIOH6HNCBKHC3AKSVFQDQSLCBBWYGWBGHRAHAIA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792219916 (296h45m53.388990942s) [noise=true , address=193.149.164.68:4059  , piece_id=HKJ2X5SD36GYMUH3GPCQ6CMLWFHNEIGVICKPLBEDAAZUSOIRLCHQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792479052 (296h45m53.389250076s) [noise=true , address=145.79.227.29:4950   , piece_id=4ADYJ4RC2XGREHG555QTOQ2N7CJEKYO5LP4CZOGWQO76O4WO2GXA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792644922 (296h45m53.389415949s) [noise=true , address=79.127.219.38:4823   , piece_id=B2TSI2CR4MS5RAYRE6OSWPQHBMZWO2AXSXTCBDEM5OQYOMKLXLVQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792897062 (296h45m53.389668086s) [noise=true , address=193.149.164.70:4111  , piece_id=WQDNO6QQFTXHGTCGVPIXT5FDELGW7U6IRV6MFB7SNOSAP56I5OAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.793280967 (296h45m53.39005199s) [noise=true , address=79.127.205.234:4209  , piece_id=KKSPDUNI3Q2UQWUSH4HALIQEA4VNND7YZNW3XYGYRTJH6RAEX4SQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.793656654 (296h45m53.390427678s) [noise=true , address=193.149.164.66:4971  , piece_id=DILXPCN72OF2R37BBWT73BOMQ4IN5GUFGQODDZEWGF76W3TGKP4Q, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794103390 (296h45m53.390874424s) [noise=true , address=167.17.72.69:4712    , piece_id=OLPGFH3D6SOEOUFVFLX2FARU5BLV6KOXQFIHK2J3FDRHAXCY55DA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794560718 (296h45m53.391331753s) [noise=true , address=45.91.116.6:4988     , piece_id=LRFXVYQFVMQAIUJQA3YZ5DQXM6MHGQGRSQ37HMWP6JQRU47OBM6Q, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794727989 (296h45m53.391499022s) [noise=true , address=193.149.164.67:4010  , piece_id=TLCNHMHTVCBQOJM3YJHBWRJ5QL5PA4BBVLFQFVQQPZVSFFW2WIAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.865906622 (296h45m53.462677645s) [upload=332403]: Next returned nil segment
Mar 18 19:45:55.865920940 (296h45m53.462691964s) [upload=332403]: Waiting for error group managing segments...
Mar 18 19:45:55.870616444 (296h45m53.467387466s) [noise=true , address=45.91.116.13:4162    , piece_id=RT7EUK6JVB2UP3A723UR4HRFEA4Z2GHKH5W4IH3SBOONSS6FWAPQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.894544169 (296h45m53.491315192s) [noise=true , address=79.127.219.41:4952   , piece_id=GA2QLS5J7XCVEGDKI4Z6WINI2TVR6W4EU2M2EYRZRRD3SVXS2IGQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.899772071 (296h45m53.496543098s) [noise=true , address=79.127.219.38:4823   , piece_id=B2TSI2CR4MS5RAYRE6OSWPQHBMZWO2AXSXTCBDEM5OQYOMKLXLVQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.904999236 (296h45m53.50177027s) [noise=true , address=45.91.116.6:4988     , piece_id=LRFXVYQFVMQAIUJQA3YZ5DQXM6MHGQGRSQ37HMWP6JQRU47OBM6Q, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.021706933 (296h45m53.618477957s) [noise=true , address=5.231.73.5:4002      , piece_id=HAZJLW6KUVIDKXJGDO7K2H2HYGNEYRLU4LGPGNVCQY6EC74PAXMQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.110307628 (296h45m53.70707864s) [noise=true , address=167.17.72.69:4712    , piece_id=OLPGFH3D6SOEOUFVFLX2FARU5BLV6KOXQFIHK2J3FDRHAXCY55DA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.377699419 (296h45m53.974470452s) [noise=true , address=167.17.72.68:4647    , piece_id=XEZKY23SYZHEDLIOH6HNCBKHC3AKSVFQDQSLCBBWYGWBGHRAHAIA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.382901915 (296h45m53.97967294s) [noise=true , address=79.127.205.234:4209  , piece_id=KKSPDUNI3Q2UQWUSH4HALIQEA4VNND7YZNW3XYGYRTJH6RAEX4SQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.386677188 (296h45m53.983448225s) [noise=true , address=193.149.164.71:4302  , piece_id=PNWOIFQEIY4WBL3ORLFYR4HAT6CNEPJVG4VZK3FX67BFPQKXKVQA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.388553638 (296h45m53.98532466s) [noise=true , address=193.149.164.68:4059  , piece_id=HKJ2X5SD36GYMUH3GPCQ6CMLWFHNEIGVICKPLBEDAAZUSOIRLCHQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.390393833 (296h45m53.987164863s) [noise=true , address=193.149.164.67:4010  , piece_id=TLCNHMHTVCBQOJM3YJHBWRJ5QL5PA4BBVLFQFVQQPZVSFFW2WIAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.403432758 (296h45m54.000203784s) [noise=true , address=193.149.164.70:4111  , piece_id=WQDNO6QQFTXHGTCGVPIXT5FDELGW7U6IRV6MFB7SNOSAP56I5OAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.427114690 (296h45m54.023885721s) [noise=true , address=193.149.164.66:4971  , piece_id=DILXPCN72OF2R37BBWT73BOMQ4IN5GUFGQODDZEWGF76W3TGKP4Q, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:46:55.682258821 (296h46m53.279029844s) [noise=true , address=145.79.227.23:4578   , piece_id=2KCMG54RKOZWTIIVKHNV53OLRQJGKTWL6NXZUWAI7BQ3QECLKYUQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1poqPvwwjWwAAhkJ5WCDavg9oKxbJrf9xktnYA9DB6o9BV1G49, address:145.79.227.23:4578): protocol: rpc: dial tcp 145.79.227.23:4578: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682680668 (296h46m53.279451698s) [noise=true , address=145.79.227.36:4524   , piece_id=7PCXCZVEWF5WLFNW5NZ3GZRB2EOY3YCJUMBH2TQHVZOEXFVMKGJA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1xfbCzjSwFDRrR1gPggeN8tNCLbRRWDVzCJ6mqhZsbVSe8d4s4, address:145.79.227.36:4524): protocol: rpc: dial tcp 145.79.227.36:4524: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682762192 (296h46m53.279533209s) [noise=true , address=145.79.227.29:4950   , piece_id=4ADYJ4RC2XGREHG555QTOQ2N7CJEKYO5LP4CZOGWQO76O4WO2GXA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1Y6fZC1qCRQYMEvW3475SvnaWYCidxcDhch2YA1ZXW5U8fXDZk, address:145.79.227.29:4950): protocol: rpc: dial tcp 145.79.227.29:4950: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682895077 (296h46m53.279666109s) [noise=true , address=145.79.227.25:4645   , piece_id=3MMI4Q6W6OBE7GCMBQURI2XH2AVCGS4EHJ4YR62RPLWQSTQXTKAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:12NPZfT1KXFLcfPTjX8zLQ4gpagKYosJbvCTKu9sK7989hDjTPm, address:145.79.227.25:4645): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:46:55.683203531 (296h46m53.279974563s) [noise=true , address=145.79.227.32:4842   , piece_id=KBG43B73ULN5RNVJEC4QPYXN2XUQB5AVSI3HZXJZMW3ID6TWMJJA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:125yXSpQg4vxVMtduWXbAUqsLRvQ2b2cDBgHi7Z23dz4fvo5Det, address:145.79.227.32:4842): protocol: rpc: dial tcp 145.79.227.32:4842: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.683243691 (296h46m53.280014715s) [seg_pos={0 0}, upload=332403]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:46:55.707909052 (296h46m53.304680079s) [upload=332403]: Done uploading segments...
Mar 18 19:46:55.707973425 (296h46m53.304744453s) [upload=332403]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1.377778783s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [...............................................X..........XX]
duration: 
1m8.726618243s
trace: 
https://jaeger.dev.storj.io/trace/5523a20bc980b101
FAIL (2026-03-18 19:46:56 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 18 19:45:47.783818234 (296h45m45.380589258s) [upload=332400]: Starting upload
Mar 18 19:45:47.783867100 (296h45m45.380638128s) [upload=332400]: Done starting upload
Mar 18 19:45:47.784058237 (296h45m45.380829252s) [upload=332400]: Uploading segments...
Mar 18 19:45:47.784217822 (296h45m45.380988839s) [upload=332400]: Got next segment. Inline: false
Mar 18 19:45:47.784277791 (296h45m45.381048816s) [upload=332400]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:45:47.784283676 (296h45m45.381054699s) [upload=332400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:45:53.718718928 (296h45m51.315489941s) [seg_pos={0 0}, upload=332400]: Begin upload segment...
Mar 18 19:45:53.718787653 (296h45m51.315558666s) [seg_pos={0 0}, upload=332400]: Done begin upload segment.
Mar 18 19:45:53.718819149 (296h45m51.315590179s) [noise=true , address=77.90.31.21:4891     , piece_id=6AUH3CDUL3E2CSXCEH4HFQYHJVWU2ZG425G7QRHP7NT5BFH2YADQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.719160161 (296h45m51.315931174s) [noise=true , address=77.90.31.19:4869     , piece_id=5TMZ4LGJMKESRICI7O3Y2OD3KCJTPUTKKN3TY63777QVI3ZV4X5Q, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.719764263 (296h45m51.316535289s) [noise=true , address=193.149.164.70:4106  , piece_id=55GLTT7UR7JXSD62YX56DWFJREAJW7DAQIHPLVLAXGJ7WANRSISQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720194880 (296h45m51.316965904s) [noise=true , address=193.149.164.71:4298  , piece_id=42JKRNQZILCBQNMHTX7QQQA2DYL5OZYERPZIOTDWSUPHHBFH5G3A, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720544743 (296h45m51.317315768s) [noise=true , address=77.90.31.18:4836     , piece_id=JDDWWNJYDZ6T6HJVZYPNU6KQG4ZAB7QMYZ62PMKGZLW2Q7M3KKKA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720887823 (296h45m51.317658847s) [noise=true , address=193.149.164.69:4092  , piece_id=SZSYSTBUECV6VKZK6EVY4VFX4WFZ3ETGC3Z74CBEHKM5CAR66KCA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.720968422 (296h45m51.317739453s) [noise=true , address=167.17.72.71:4811    , piece_id=VPTCMDGBAHYL7SLP3MFJAQEDFISJUOHHX6Q47KMORGGV222U3TFA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721219044 (296h45m51.31799007s) [noise=true , address=45.91.116.7:4039     , piece_id=RBOT6ELM2Q2QLUTNXTKKBHCLLCW36YEKQSJTTYKDDWENLDNMK3PQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721570459 (296h45m51.3183415s) [noise=true , address=5.231.73.3:4035      , piece_id=KVMQREYDNSATBYYL4TUZT3GCKBE3ETYL6VGKLHF6UY4NBK7IKLBA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721602095 (296h45m51.318373127s) [noise=true , address=79.127.219.38:4852   , piece_id=7CKIYDCMA5MVSQLXB5HMGVAQ5WB424E6FLGR5FU5FK327IT2UF6A, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.721986658 (296h45m51.318757688s) [noise=true , address=45.91.116.9:4275     , piece_id=BV774XRSJDSFHQNXAG6OUHXNWKYS4QGR5O32EAQGTJ7NKP5GTLNA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722198475 (296h45m51.318969505s) [noise=true , address=145.79.227.39:4019   , piece_id=TQPAWK7HNSHZFXJACKX7GY5HLKFTMIHM6UEUQDWNPXTCXRD474JQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722398638 (296h45m51.319169663s) [noise=true , address=79.127.219.45:4877   , piece_id=35BGI5RC5WY2MCDXUG5G2ZNJDFXVIVJMVTA2GJLNDO56BIJICNUQ, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722749083 (296h45m51.319520106s) [noise=true , address=145.79.227.33:4899   , piece_id=ICWNN3O7JCFXX6LZSEYPTO2BXGCCL6HII7L65HIUJPVP4JTGLA2Q, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.722769687 (296h45m51.31954072s) [noise=true , address=145.79.227.43:4164   , piece_id=ALX5HWAFWYH4VTW2X44QJ6GRIEXARB6WT2EGZKNYDVZ2D7HRLGXA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.723491136 (296h45m51.320262173s) [noise=true , address=145.79.227.36:4548   , piece_id=AEJ7VUY5PT3EMWAPYH5QWEVZZR5KFTSXAKYGEGP7OMP77UKV5APA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.724120874 (296h45m51.32089191s) [noise=true , address=145.79.227.47:4271   , piece_id=FUSS3WBGHZ4OA7LXH5RHFVBAA6WXDT4CEW32XEQUVLRDBIUUPHCA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.724738220 (296h45m51.321509254s) [noise=true , address=167.17.72.69:4744    , piece_id=L6YR6XSULEAGDS4J3VKRF3MTPMO4FTK2DSNQE5LZMRP5TNIU7IFA, seg_pos={0 0}, upload=332400]: Uploading piece...
Mar 18 19:45:53.790526416 (296h45m51.387297444s) [upload=332400]: Next returned nil segment
Mar 18 19:45:53.790550359 (296h45m51.387321382s) [upload=332400]: Waiting for error group managing segments...
Mar 18 19:45:53.798488443 (296h45m51.395259471s) [noise=true , address=79.127.219.38:4852   , piece_id=7CKIYDCMA5MVSQLXB5HMGVAQ5WB424E6FLGR5FU5FK327IT2UF6A, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.802946429 (296h45m51.399717462s) [noise=true , address=45.91.116.7:4039     , piece_id=RBOT6ELM2Q2QLUTNXTKKBHCLLCW36YEKQSJTTYKDDWENLDNMK3PQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.803155500 (296h45m51.399926534s) [noise=true , address=45.91.116.9:4275     , piece_id=BV774XRSJDSFHQNXAG6OUHXNWKYS4QGR5O32EAQGTJ7NKP5GTLNA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.811586493 (296h45m51.408357516s) [noise=true , address=77.90.31.21:4891     , piece_id=6AUH3CDUL3E2CSXCEH4HFQYHJVWU2ZG425G7QRHP7NT5BFH2YADQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.825088508 (296h45m51.42185952s) [noise=true , address=77.90.31.18:4836     , piece_id=JDDWWNJYDZ6T6HJVZYPNU6KQG4ZAB7QMYZ62PMKGZLW2Q7M3KKKA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.831222274 (296h45m51.427993297s) [noise=true , address=77.90.31.19:4869     , piece_id=5TMZ4LGJMKESRICI7O3Y2OD3KCJTPUTKKN3TY63777QVI3ZV4X5Q, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:53.950311914 (296h45m51.547082938s) [noise=true , address=5.231.73.3:4035      , piece_id=KVMQREYDNSATBYYL4TUZT3GCKBE3ETYL6VGKLHF6UY4NBK7IKLBA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.076237110 (296h45m51.673008123s) [noise=true , address=167.17.72.69:4744    , piece_id=L6YR6XSULEAGDS4J3VKRF3MTPMO4FTK2DSNQE5LZMRP5TNIU7IFA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.255654117 (296h45m51.852425141s) [noise=true , address=79.127.219.45:4877   , piece_id=35BGI5RC5WY2MCDXUG5G2ZNJDFXVIVJMVTA2GJLNDO56BIJICNUQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.315125295 (296h45m51.911896307s) [noise=true , address=193.149.164.71:4298  , piece_id=42JKRNQZILCBQNMHTX7QQQA2DYL5OZYERPZIOTDWSUPHHBFH5G3A, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.328922853 (296h45m51.925693876s) [noise=true , address=193.149.164.70:4106  , piece_id=55GLTT7UR7JXSD62YX56DWFJREAJW7DAQIHPLVLAXGJ7WANRSISQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.341857790 (296h45m51.938628803s) [noise=true , address=193.149.164.69:4092  , piece_id=SZSYSTBUECV6VKZK6EVY4VFX4WFZ3ETGC3Z74CBEHKM5CAR66KCA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:45:54.730608194 (296h45m52.327379208s) [noise=true , address=167.17.72.71:4811    , piece_id=VPTCMDGBAHYL7SLP3MFJAQEDFISJUOHHX6Q47KMORGGV222U3TFA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: <nil>
Mar 18 19:46:47.734237495 (296h46m45.331008534s) [noise=true , address=145.79.227.39:4019   , piece_id=TQPAWK7HNSHZFXJACKX7GY5HLKFTMIHM6UEUQDWNPXTCXRD474JQ, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:1ztmvXKmY6hicHZD7iejpcJCKFEhLwemtaYChAp8Po85TRQvGo, address:145.79.227.39:4019): protocol: rpc: dial tcp 145.79.227.39:4019: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.734544842 (296h46m45.331315874s) [noise=true , address=145.79.227.43:4164   , piece_id=ALX5HWAFWYH4VTW2X44QJ6GRIEXARB6WT2EGZKNYDVZ2D7HRLGXA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:1gUXWffNccBoXWftiMWHHSTeEpA5zrd2cHz4uXX5j75GeEK9s2, address:145.79.227.43:4164): protocol: rpc: dial tcp 145.79.227.43:4164: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.734855639 (296h46m45.331626668s) [noise=true , address=145.79.227.33:4899   , piece_id=ICWNN3O7JCFXX6LZSEYPTO2BXGCCL6HII7L65HIUJPVP4JTGLA2Q, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw, address:145.79.227.33:4899): protocol: rpc: dial tcp 145.79.227.33:4899: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.735109238 (296h46m45.33188027s) [noise=true , address=145.79.227.36:4548   , piece_id=AEJ7VUY5PT3EMWAPYH5QWEVZZR5KFTSXAKYGEGP7OMP77UKV5APA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT, address:145.79.227.36:4548): protocol: rpc: dial tcp 145.79.227.36:4548: i/o timeout; conn closed: op
Mar 18 19:46:47.735331971 (296h46m45.332102985s) [noise=true , address=145.79.227.47:4271   , piece_id=FUSS3WBGHZ4OA7LXH5RHFVBAA6WXDT4CEW32XEQUVLRDBIUUPHCA, seg_pos={0 0}, upload=332400]: Done uploading piece. err: ecclient: upload failed (node:12QwLHnMQHafFPYL83gE6wffvzdkvCHwzzVMLBz4KBVdE7ynuf1, address:145.79.227.47:4271): protocol: rpc: dial tcp 145.79.227.47:4271: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:47.735448827 (296h46m45.33221985s) [seg_pos={0 0}, upload=332400]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:46:56.457707078 (296h46m54.054478111s) [upload=332400]: Done uploading segments...
Mar 18 19:46:56.457798262 (296h46m54.054569296s) [upload=332400]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m8.726639289s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [..............................................XXX..........X]
duration: 
1m0.029203609s
trace: 
https://jaeger.dev.storj.io/trace/1bf479969b665dd4
FAIL (2026-03-18 19:46:55 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
upload
Mar 18 19:45:55.724413588 (296h45m53.321184616s) [upload=332403]: Uploading segments...
Mar 18 19:45:55.724976725 (296h45m53.321747753s) [upload=332403]: Got next segment. Inline: false
Mar 18 19:45:55.725055562 (296h45m53.32182659s) [upload=332403]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:45:55.725062440 (296h45m53.32183347s) [upload=332403]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:45:55.789537410 (296h45m53.386308434s) [seg_pos={0 0}, upload=332403]: Begin upload segment...
Mar 18 19:45:55.789593684 (296h45m53.386364714s) [seg_pos={0 0}, upload=332403]: Done begin upload segment.
Mar 18 19:45:55.789627617 (296h45m53.386398644s) [noise=true , address=79.127.219.41:4952   , piece_id=GA2QLS5J7XCVEGDKI4Z6WINI2TVR6W4EU2M2EYRZRRD3SVXS2IGQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.789682580 (296h45m53.386453603s) [noise=true , address=145.79.227.32:4842   , piece_id=KBG43B73ULN5RNVJEC4QPYXN2XUQB5AVSI3HZXJZMW3ID6TWMJJA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.790244853 (296h45m53.38701588s) [noise=true , address=45.91.116.13:4162    , piece_id=RT7EUK6JVB2UP3A723UR4HRFEA4Z2GHKH5W4IH3SBOONSS6FWAPQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.790739907 (296h45m53.387510937s) [noise=true , address=145.79.227.36:4524   , piece_id=7PCXCZVEWF5WLFNW5NZ3GZRB2EOY3YCJUMBH2TQHVZOEXFVMKGJA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791134756 (296h45m53.387905781s) [noise=true , address=193.149.164.71:4302  , piece_id=PNWOIFQEIY4WBL3ORLFYR4HAT6CNEPJVG4VZK3FX67BFPQKXKVQA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791272401 (296h45m53.388043424s) [noise=true , address=145.79.227.25:4645   , piece_id=3MMI4Q6W6OBE7GCMBQURI2XH2AVCGS4EHJ4YR62RPLWQSTQXTKAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791656304 (296h45m53.388427327s) [noise=true , address=145.79.227.23:4578   , piece_id=2KCMG54RKOZWTIIVKHNV53OLRQJGKTWL6NXZUWAI7BQ3QECLKYUQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.791800576 (296h45m53.388571599s) [noise=true , address=5.231.73.5:4002      , piece_id=HAZJLW6KUVIDKXJGDO7K2H2HYGNEYRLU4LGPGNVCQY6EC74PAXMQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792080702 (296h45m53.388851725s) [noise=true , address=167.17.72.68:4647    , piece_id=XEZKY23SYZHEDLIOH6HNCBKHC3AKSVFQDQSLCBBWYGWBGHRAHAIA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792219916 (296h45m53.388990942s) [noise=true , address=193.149.164.68:4059  , piece_id=HKJ2X5SD36GYMUH3GPCQ6CMLWFHNEIGVICKPLBEDAAZUSOIRLCHQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792479052 (296h45m53.389250076s) [noise=true , address=145.79.227.29:4950   , piece_id=4ADYJ4RC2XGREHG555QTOQ2N7CJEKYO5LP4CZOGWQO76O4WO2GXA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792644922 (296h45m53.389415949s) [noise=true , address=79.127.219.38:4823   , piece_id=B2TSI2CR4MS5RAYRE6OSWPQHBMZWO2AXSXTCBDEM5OQYOMKLXLVQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.792897062 (296h45m53.389668086s) [noise=true , address=193.149.164.70:4111  , piece_id=WQDNO6QQFTXHGTCGVPIXT5FDELGW7U6IRV6MFB7SNOSAP56I5OAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.793280967 (296h45m53.39005199s) [noise=true , address=79.127.205.234:4209  , piece_id=KKSPDUNI3Q2UQWUSH4HALIQEA4VNND7YZNW3XYGYRTJH6RAEX4SQ, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.793656654 (296h45m53.390427678s) [noise=true , address=193.149.164.66:4971  , piece_id=DILXPCN72OF2R37BBWT73BOMQ4IN5GUFGQODDZEWGF76W3TGKP4Q, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794103390 (296h45m53.390874424s) [noise=true , address=167.17.72.69:4712    , piece_id=OLPGFH3D6SOEOUFVFLX2FARU5BLV6KOXQFIHK2J3FDRHAXCY55DA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794560718 (296h45m53.391331753s) [noise=true , address=45.91.116.6:4988     , piece_id=LRFXVYQFVMQAIUJQA3YZ5DQXM6MHGQGRSQ37HMWP6JQRU47OBM6Q, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.794727989 (296h45m53.391499022s) [noise=true , address=193.149.164.67:4010  , piece_id=TLCNHMHTVCBQOJM3YJHBWRJ5QL5PA4BBVLFQFVQQPZVSFFW2WIAA, seg_pos={0 0}, upload=332403]: Uploading piece...
Mar 18 19:45:55.865906622 (296h45m53.462677645s) [upload=332403]: Next returned nil segment
Mar 18 19:45:55.865920940 (296h45m53.462691964s) [upload=332403]: Waiting for error group managing segments...
Mar 18 19:45:55.870616444 (296h45m53.467387466s) [noise=true , address=45.91.116.13:4162    , piece_id=RT7EUK6JVB2UP3A723UR4HRFEA4Z2GHKH5W4IH3SBOONSS6FWAPQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.894544169 (296h45m53.491315192s) [noise=true , address=79.127.219.41:4952   , piece_id=GA2QLS5J7XCVEGDKI4Z6WINI2TVR6W4EU2M2EYRZRRD3SVXS2IGQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.899772071 (296h45m53.496543098s) [noise=true , address=79.127.219.38:4823   , piece_id=B2TSI2CR4MS5RAYRE6OSWPQHBMZWO2AXSXTCBDEM5OQYOMKLXLVQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:55.904999236 (296h45m53.50177027s) [noise=true , address=45.91.116.6:4988     , piece_id=LRFXVYQFVMQAIUJQA3YZ5DQXM6MHGQGRSQ37HMWP6JQRU47OBM6Q, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.021706933 (296h45m53.618477957s) [noise=true , address=5.231.73.5:4002      , piece_id=HAZJLW6KUVIDKXJGDO7K2H2HYGNEYRLU4LGPGNVCQY6EC74PAXMQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.110307628 (296h45m53.70707864s) [noise=true , address=167.17.72.69:4712    , piece_id=OLPGFH3D6SOEOUFVFLX2FARU5BLV6KOXQFIHK2J3FDRHAXCY55DA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.377699419 (296h45m53.974470452s) [noise=true , address=167.17.72.68:4647    , piece_id=XEZKY23SYZHEDLIOH6HNCBKHC3AKSVFQDQSLCBBWYGWBGHRAHAIA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.382901915 (296h45m53.97967294s) [noise=true , address=79.127.205.234:4209  , piece_id=KKSPDUNI3Q2UQWUSH4HALIQEA4VNND7YZNW3XYGYRTJH6RAEX4SQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.386677188 (296h45m53.983448225s) [noise=true , address=193.149.164.71:4302  , piece_id=PNWOIFQEIY4WBL3ORLFYR4HAT6CNEPJVG4VZK3FX67BFPQKXKVQA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.388553638 (296h45m53.98532466s) [noise=true , address=193.149.164.68:4059  , piece_id=HKJ2X5SD36GYMUH3GPCQ6CMLWFHNEIGVICKPLBEDAAZUSOIRLCHQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.390393833 (296h45m53.987164863s) [noise=true , address=193.149.164.67:4010  , piece_id=TLCNHMHTVCBQOJM3YJHBWRJ5QL5PA4BBVLFQFVQQPZVSFFW2WIAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.403432758 (296h45m54.000203784s) [noise=true , address=193.149.164.70:4111  , piece_id=WQDNO6QQFTXHGTCGVPIXT5FDELGW7U6IRV6MFB7SNOSAP56I5OAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:45:56.427114690 (296h45m54.023885721s) [noise=true , address=193.149.164.66:4971  , piece_id=DILXPCN72OF2R37BBWT73BOMQ4IN5GUFGQODDZEWGF76W3TGKP4Q, seg_pos={0 0}, upload=332403]: Done uploading piece. err: <nil>
Mar 18 19:46:55.682258821 (296h46m53.279029844s) [noise=true , address=145.79.227.23:4578   , piece_id=2KCMG54RKOZWTIIVKHNV53OLRQJGKTWL6NXZUWAI7BQ3QECLKYUQ, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1poqPvwwjWwAAhkJ5WCDavg9oKxbJrf9xktnYA9DB6o9BV1G49, address:145.79.227.23:4578): protocol: rpc: dial tcp 145.79.227.23:4578: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682680668 (296h46m53.279451698s) [noise=true , address=145.79.227.36:4524   , piece_id=7PCXCZVEWF5WLFNW5NZ3GZRB2EOY3YCJUMBH2TQHVZOEXFVMKGJA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1xfbCzjSwFDRrR1gPggeN8tNCLbRRWDVzCJ6mqhZsbVSe8d4s4, address:145.79.227.36:4524): protocol: rpc: dial tcp 145.79.227.36:4524: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682762192 (296h46m53.279533209s) [noise=true , address=145.79.227.29:4950   , piece_id=4ADYJ4RC2XGREHG555QTOQ2N7CJEKYO5LP4CZOGWQO76O4WO2GXA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:1Y6fZC1qCRQYMEvW3475SvnaWYCidxcDhch2YA1ZXW5U8fXDZk, address:145.79.227.29:4950): protocol: rpc: dial tcp 145.79.227.29:4950: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.682895077 (296h46m53.279666109s) [noise=true , address=145.79.227.25:4645   , piece_id=3MMI4Q6W6OBE7GCMBQURI2XH2AVCGS4EHJ4YR62RPLWQSTQXTKAA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:12NPZfT1KXFLcfPTjX8zLQ4gpagKYosJbvCTKu9sK7989hDjTPm, address:145.79.227.25:4645): protocol: context deadline exceeded; context deadline exceeded
Mar 18 19:46:55.683203531 (296h46m53.279974563s) [noise=true , address=145.79.227.32:4842   , piece_id=KBG43B73ULN5RNVJEC4QPYXN2XUQB5AVSI3HZXJZMW3ID6TWMJJA, seg_pos={0 0}, upload=332403]: Done uploading piece. err: ecclient: upload failed (node:125yXSpQg4vxVMtduWXbAUqsLRvQ2b2cDBgHi7Z23dz4fvo5Det, address:145.79.227.32:4842): protocol: rpc: dial tcp 145.79.227.32:4842: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:55.683243691 (296h46m53.280014715s) [seg_pos={0 0}, upload=332403]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:46:55.707909052 (296h46m53.304680079s) [upload=332403]: Done uploading segments...
Mar 18 19:46:55.707973425 (296h46m53.304744453s) [upload=332403]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.029232618s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
19 out of 60 is failed (threshold=6) [.....................................XXXXXXXXX.XXX...XXXXXXX]
duration: 
5.00154069s
trace: 
https://jaeger.dev.storj.io/trace/12b183ee1dde8730
FAIL (2026-03-18 19:46:48 UTC) 
operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001564187s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX]
duration: 
30.032008827s
trace: 
https://jaeger.dev.storj.io/trace/2943e6802f123543
FAIL (2026-03-18 19:46:37 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
nt...
Mar 18 19:46:07.645523932 (296h46m5.242294955s) [seg_pos={0 0}, upload=332408]: Done begin upload segment.
Mar 18 19:46:07.645575022 (296h46m5.242346051s) [noise=true , address=145.79.227.2:4113    , piece_id=GZHOWLSKZ3AUYPUUXTANS472QBAHEDXATV2CF4DPX6Y2OST3XV2Q, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.645594187 (296h46m5.242365222s) [noise=true , address=145.79.227.24:4585   , piece_id=M2RSCWZWMZWI3U5AQGKFUS3NBK6ADDMDK7MEVGOL6IJW4XHB3KIQ, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.646277727 (296h46m5.243048759s) [noise=true , address=145.79.227.42:4123   , piece_id=O36C2M2GSURLDL57IHYIHXTYKJRP3GCDYE6MJJPUVREY7YUFZYRA, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.646766965 (296h46m5.243537989s) [noise=true , address=145.79.227.28:4728   , piece_id=LJEQAJVL2PI52AGQJ32Y6ATCYGYRLRO5OAD7LKQA4JEANANKAUCA, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.647212243 (296h46m5.243983276s) [noise=true , address=145.79.227.39:4017   , piece_id=AE2RD2REB4M65RYNPKBOSZ6ILKA3MKAPTX4TMDGTGMZ54O6N7LUQ, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.647285160 (296h46m5.24405619s) [noise=true , address=145.79.227.41:4085   , piece_id=MZQVHMIF344IOA346723SBCJWZYIZU6LJPECZFLOHWWABXCHHYJA, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.647747277 (296h46m5.244518311s) [noise=true , address=77.90.31.15:4702     , piece_id=AS67QCXNO76MRDQ5ZY7K4MWNG2QYWSIFSASDRNAFLSFQV35AEOTA, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.647829095 (296h46m5.244600107s) [noise=true , address=145.79.227.15:4878   , piece_id=BJFWZMNHG6FNO7MCDRMA5N35VH4YAMDPPRRAMCPOYWAEDTFRVWWQ, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.648138515 (296h46m5.244909545s) [noise=true , address=145.79.227.40:4049   , piece_id=PHAFEFWRAS2N3UES2X26NWFMHVZFJQD6ZF2SL45ROW7I63A6Y3EA, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.648332657 (296h46m5.245103688s) [noise=true , address=145.79.227.25:4623   , piece_id=7R7SAIWWMHTE7IR4OZS3SOTTVSGZFSM7TVN7SNKLARCLG6W5FFPQ, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.648535177 (296h46m5.245306207s) [noise=true , address=45.91.116.9:4263     , piece_id=WUQBO5U6USQNOXJAJOHTX34JGOHMTEO7CGAVCJGRKGFZMUFSZU6A, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.648769732 (296h46m5.245540761s) [noise=true , address=145.79.227.50:4375   , piece_id=6BFNZDI2WVOZ4BB5FWL6T2JVXGY6F3KRXTBXSXTALFPZ3UTG7FNQ, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.648896985 (296h46m5.245668017s) [noise=true , address=45.91.116.14:4189    , piece_id=7TI2GAGGRXIKPINM5HF7INJOZBJZ3SCTYLOACGABMHSPBEQXCCIQ, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.649213520 (296h46m5.245984547s) [noise=true , address=45.91.116.5:4297     , piece_id=UPUW7G2AWBWNQLOTNR3QBFJ3OPELSI63TH2D6IZ4SDNFV3YUDY4A, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.649776280 (296h46m5.246547314s) [noise=true , address=145.79.227.51:4409   , piece_id=66WKI2LEEJ7DOAHT5CDC77OMWFODXYEWGGYEK6AKVGETOVYZ573A, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.650385539 (296h46m5.24715657s) [noise=true , address=45.91.116.13:4155    , piece_id=SKVVI5W35ZPMTIJZ6E4ZV2JSUQ5IRJEJ2SPX4T6G3S4XQZIX4DQQ, seg_pos={0 0}, upload=332408]: Uploading piece...
Mar 18 19:46:07.725648987 (296h46m5.32242s) [upload=332408]: Next returned nil segment
Mar 18 19:46:07.725666848 (296h46m5.322437882s) [upload=332408]: Waiting for error group managing segments...
Mar 18 19:46:07.730113661 (296h46m5.326884706s) [noise=true , address=45.91.116.14:4189    , piece_id=7TI2GAGGRXIKPINM5HF7INJOZBJZ3SCTYLOACGABMHSPBEQXCCIQ, seg_pos={0 0}, upload=332408]: Done uploading piece. err: <nil>
Mar 18 19:46:07.730772526 (296h46m5.327543559s) [noise=true , address=45.91.116.5:4297     , piece_id=UPUW7G2AWBWNQLOTNR3QBFJ3OPELSI63TH2D6IZ4SDNFV3YUDY4A, seg_pos={0 0}, upload=332408]: Done uploading piece. err: <nil>
Mar 18 19:46:07.731127406 (296h46m5.327898429s) [noise=true , address=45.91.116.13:4155    , piece_id=SKVVI5W35ZPMTIJZ6E4ZV2JSUQ5IRJEJ2SPX4T6G3S4XQZIX4DQQ, seg_pos={0 0}, upload=332408]: Done uploading piece. err: <nil>
Mar 18 19:46:07.746610062 (296h46m5.343381087s) [noise=true , address=45.91.116.9:4263     , piece_id=WUQBO5U6USQNOXJAJOHTX34JGOHMTEO7CGAVCJGRKGFZMUFSZU6A, seg_pos={0 0}, upload=332408]: Done uploading piece. err: <nil>
Mar 18 19:46:07.750421698 (296h46m5.347192728s) [noise=true , address=77.90.31.15:4702     , piece_id=AS67QCXNO76MRDQ5ZY7K4MWNG2QYWSIFSASDRNAFLSFQV35AEOTA, seg_pos={0 0}, upload=332408]: Done uploading piece. err: <nil>
Mar 18 19:46:37.581263123 (296h46m35.178034169s) [noise=true , address=145.79.227.40:4049   , piece_id=PHAFEFWRAS2N3UES2X26NWFMHVZFJQD6ZF2SL45ROW7I63A6Y3EA, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:1n91vwhc11FPE57QAUCfgDpffrmPrJxWxh7R9ecgt41JEPux6J, address:145.79.227.40:4049): protocol: rpc: dial tcp 145.79.227.40:4049: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.581361499 (296h46m35.178132531s) [noise=true , address=145.79.227.41:4085   , piece_id=MZQVHMIF344IOA346723SBCJWZYIZU6LJPECZFLOHWWABXCHHYJA, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: rpc: dial tcp 145.79.227.41:4085: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.581490798 (296h46m35.178261828s) [noise=true , address=145.79.227.51:4409   , piece_id=66WKI2LEEJ7DOAHT5CDC77OMWFODXYEWGGYEK6AKVGETOVYZ573A, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj, address:145.79.227.51:4409): protocol: rpc: dial tcp 145.79.227.51:4409: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.581708946 (296h46m35.178479969s) [noise=true , address=145.79.227.24:4585   , piece_id=M2RSCWZWMZWI3U5AQGKFUS3NBK6ADDMDK7MEVGOL6IJW4XHB3KIQ, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:1TyK6onzVds1kucaD6Y4aPssPDM5FzzQ91dTrez5B7ttfwvXm, address:145.79.227.24:4585): protocol: rpc: dial tcp 145.79.227.24:4585: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.581825534 (296h46m35.178596566s) [noise=true , address=145.79.227.2:4113    , piece_id=GZHOWLSKZ3AUYPUUXTANS472QBAHEDXATV2CF4DPX6Y2OST3XV2Q, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:145.79.227.2:4113): protocol: rpc: dial tcp 145.79.227.2:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.582154029 (296h46m35.178925051s) [noise=true , address=145.79.227.28:4728   , piece_id=LJEQAJVL2PI52AGQJ32Y6ATCYGYRLRO5OAD7LKQA4JEANANKAUCA, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:1YoLzpb4mMYZ8TsdxnMocekZZ1gLfTrdCM8mxTDj4tY6khZGvi, address:145.79.227.28:4728): protocol: rpc: dial tcp 145.79.227.28:4728: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.582703292 (296h46m35.179474318s) [noise=true , address=145.79.227.50:4375   , piece_id=6BFNZDI2WVOZ4BB5FWL6T2JVXGY6F3KRXTBXSXTALFPZ3UTG7FNQ, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5, address:145.79.227.50:4375): protocol: rpc: dial tcp 145.79.227.50:4375: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.582785391 (296h46m35.179556475s) [noise=true , address=145.79.227.39:4017   , piece_id=AE2RD2REB4M65RYNPKBOSZ6ILKA3MKAPTX4TMDGTGMZ54O6N7LUQ, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:12ocB4w2b2owjyWVCcq59Ymo2prJfSFmK5YogQDjGBroF11Tegk, address:145.79.227.39:4017): protocol: rpc: dial tcp 145.79.227.39:4017: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.582799020 (296h46m35.179570036s) [noise=true , address=145.79.227.15:4878   , piece_id=BJFWZMNHG6FNO7MCDRMA5N35VH4YAMDPPRRAMCPOYWAEDTFRVWWQ, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:126ZeAKnpjpxa3MgCBU3KZKBDdn8MfZgiixE4zR5fZpPwaQj9NC, address:145.79.227.15:4878): protocol: rpc: dial tcp 145.79.227.15:4878: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.582870229 (296h46m35.179641259s) [noise=true , address=145.79.227.25:4623   , piece_id=7R7SAIWWMHTE7IR4OZS3SOTTVSGZFSM7TVN7SNKLARCLG6W5FFPQ, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:1eJPDT9UUjY1nszjYAjafGLFRrif8NjW3pxycFXPLRL2ZA2UG5, address:145.79.227.25:4623): protocol: rpc: dial tcp 145.79.227.25:4623: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.582917689 (296h46m35.179688715s) [noise=true , address=145.79.227.42:4123   , piece_id=O36C2M2GSURLDL57IHYIHXTYKJRP3GCDYE6MJJPUVREY7YUFZYRA, seg_pos={0 0}, upload=332408]: Done uploading piece. err: ecclient: upload failed (node:12ttjngUh34tGJpCBgVCLfqrWwsdmd88XKWPrmaJrgkMu8htkKM, address:145.79.227.42:4123): protocol: rpc: dial tcp 145.79.227.42:4123: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:46:37.582944020 (296h46m35.179715033s) [seg_pos={0 0}, upload=332408]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Mar 18 19:46:37.609954387 (296h46m35.206725407s) [upload=332408]: Done uploading segments...
Mar 18 19:46:37.610002874 (296h46m35.206773914s) [upload=332408]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 30.032038547s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [.............................................XXXXXX.XX......]
duration: 
817.132895ms
trace: 
https://jaeger.dev.storj.io/trace/4b4d10a8051ad01b
FAIL (2026-03-18 19:46:29 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 817.189104ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
18 out of 60 is failed (threshold=6) [......................................XXXXXXXXX.XXX...XXXXXX]
duration: 
5.001248052s
trace: 
https://jaeger.dev.storj.io/trace/1c6c320f2b31fcb5
FAIL (2026-03-18 19:46:02 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001271666s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [................................................X..........X]
duration: 
1m3.218818421s
trace: 
https://jaeger.dev.storj.io/trace/7b00c8e570527591
FAIL (2026-03-18 19:45:47 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Mar 18 19:44:44.531335519 (296h44m42.128106551s) [upload=332380]: Starting upload
Mar 18 19:44:44.531475325 (296h44m42.128246356s) [upload=332380]: Done starting upload
Mar 18 19:44:44.531632499 (296h44m42.128403513s) [upload=332380]: Uploading segments...
Mar 18 19:44:44.531858554 (296h44m42.128629577s) [upload=332380]: Got next segment. Inline: false
Mar 18 19:44:44.531933224 (296h44m42.128704248s) [upload=332380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Mar 18 19:44:44.531939737 (296h44m42.12871076s) [upload=332380]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Mar 18 19:44:48.315984880 (296h44m45.912755906s) [seg_pos={0 0}, upload=332380]: Begin upload segment...
Mar 18 19:44:48.316064996 (296h44m45.91283602s) [seg_pos={0 0}, upload=332380]: Done begin upload segment.
Mar 18 19:44:48.316091356 (296h44m45.912862388s) [noise=true , address=193.149.164.69:4086  , piece_id=64I67SQ7XGQZTXXIM3QEUOZJ3MR4PNYTX2566KYO6XWTKV42N5EA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.316109641 (296h44m45.91288067s) [noise=true , address=167.17.72.69:4728    , piece_id=FIJM4A53FLXYPIP2FC6BMAGKXNLAOCUANADBPNSTWBH6MUXUHTAQ, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.316713887 (296h44m45.913484914s) [noise=true , address=193.149.164.67:4006  , piece_id=3UBN2ZFDDTC4MEMMCYXZIUW6BGB4XVHS2QRP4UIZULWO35NKSCHQ, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.317160473 (296h44m45.913931499s) [noise=true , address=79.127.219.38:4827   , piece_id=YRVFKYNAINZHHTMFXFS7TGH3M34HI4YOYK3GUOJRCWC6MAG7KMNA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.317720426 (296h44m45.914491456s) [noise=true , address=145.79.227.36:4541   , piece_id=JCQKPMUEG5DXBBMQCQUOW2DI2BZSOEBPXMIR7EGUBFATY33FYJTA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.318186378 (296h44m45.914957405s) [noise=true , address=79.127.219.46:4911   , piece_id=F2GG2E6Q7FJDC5W5ZHAWGPCPQ3BKC5KS4UXCXW2ZHGITTZ7K5WJQ, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.318833541 (296h44m45.915604573s) [noise=true , address=45.91.116.13:4179    , piece_id=3QXFPDPFUF6UGPXA62QOS3EQZAYCN4R62XYPU45JCBYN35ZKXNXA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.319762098 (296h44m45.916533136s) [noise=true , address=77.90.31.14:4671     , piece_id=5PBLF7RDWNO2XKERHHVQYQNSPXGS7UNDB4P3U7YZGXKZGS54LK7A, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.321366156 (296h44m45.918137183s) [noise=true , address=145.79.227.51:4423   , piece_id=NCU3O5HXGX5TTRKKKHGUMTOISBNMQQDBJJTYAAPEF7XFBBDMYPHQ, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.323285059 (296h44m45.920056091s) [noise=true , address=145.79.227.52:4474   , piece_id=LGOA3K4B53T7G7ZK55WWEINYAOH3C2PKPRNMYNJWRDRE7UXFQY7A, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.325173105 (296h44m45.921944138s) [noise=true , address=145.79.227.41:4100   , piece_id=OXEH6J5B5Y7TFVEBJNMTXN7FJIVU26SQP7UTHY727HBOHOIPASVA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.326747430 (296h44m45.923518465s) [noise=true , address=79.127.205.235:4263  , piece_id=NOFZRFE2HLK3IQS53AMY3QMBLVQLG5E5QAWVW65JOWSQK7KS6GUQ, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.327575272 (296h44m45.924346296s) [noise=true , address=77.90.31.10:4538     , piece_id=2ZQYIG3VRJRY3TKHGC4MMGEHGSOJ6OTFSUVFZQJEUXLK4P6UHXIA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.329708619 (296h44m45.926479652s) [noise=true , address=77.90.31.18:4839     , piece_id=FPRXT44J3P4H5Z6U25XOA2IRAKE37SWZJZGYT2NSSRQU2HPUXPWA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.330683776 (296h44m45.927454809s) [noise=true , address=193.149.164.68:4041  , piece_id=NU2QPZUVQGH4QIRS4Y2VVJMTTHKCAYHU7JPGBXZJ7TQ6D3C2MRGA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.333760099 (296h44m45.930531133s) [noise=true , address=45.91.116.4:4960     , piece_id=HLGV3OIX6AOSTDGXPZI3CLZQFPT76JRIN2MOHZBBGE4IUNBLNACA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.349633456 (296h44m45.946404488s) [noise=true , address=45.91.116.8:4050     , piece_id=66XX4N57QYWBEUTGYMJCMAFV5H4Q4KFCGBKJR2VJ4DFQF5ZBLMTQ, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.350929519 (296h44m45.947700547s) [noise=true , address=145.79.227.44:4214   , piece_id=NMUNQCAFF36ERUWCRJW7HQLRZL32VKVE3VVKCYUECXC45YBEJQDA, seg_pos={0 0}, upload=332380]: Uploading piece...
Mar 18 19:44:48.394353954 (296h44m45.991124984s) [upload=332380]: Next returned nil segment
Mar 18 19:44:48.394371623 (296h44m45.99114266s) [upload=332380]: Waiting for error group managing segments...
Mar 18 19:44:48.403480517 (296h44m46.000251541s) [noise=true , address=79.127.219.46:4911   , piece_id=F2GG2E6Q7FJDC5W5ZHAWGPCPQ3BKC5KS4UXCXW2ZHGITTZ7K5WJQ, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.410246355 (296h44m46.007017379s) [noise=true , address=77.90.31.14:4671     , piece_id=5PBLF7RDWNO2XKERHHVQYQNSPXGS7UNDB4P3U7YZGXKZGS54LK7A, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.412238585 (296h44m46.009009614s) [noise=true , address=45.91.116.4:4960     , piece_id=HLGV3OIX6AOSTDGXPZI3CLZQFPT76JRIN2MOHZBBGE4IUNBLNACA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.413090726 (296h44m46.00986175s) [noise=true , address=77.90.31.10:4538     , piece_id=2ZQYIG3VRJRY3TKHGC4MMGEHGSOJ6OTFSUVFZQJEUXLK4P6UHXIA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.413676024 (296h44m46.010447049s) [noise=true , address=77.90.31.18:4839     , piece_id=FPRXT44J3P4H5Z6U25XOA2IRAKE37SWZJZGYT2NSSRQU2HPUXPWA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.417145192 (296h44m46.013916215s) [noise=true , address=45.91.116.13:4179    , piece_id=3QXFPDPFUF6UGPXA62QOS3EQZAYCN4R62XYPU45JCBYN35ZKXNXA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.438259257 (296h44m46.035030282s) [noise=true , address=79.127.219.38:4827   , piece_id=YRVFKYNAINZHHTMFXFS7TGH3M34HI4YOYK3GUOJRCWC6MAG7KMNA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.516935895 (296h44m46.113706918s) [noise=true , address=45.91.116.8:4050     , piece_id=66XX4N57QYWBEUTGYMJCMAFV5H4Q4KFCGBKJR2VJ4DFQF5ZBLMTQ, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.750462656 (296h44m46.347233684s) [noise=true , address=167.17.72.69:4728    , piece_id=FIJM4A53FLXYPIP2FC6BMAGKXNLAOCUANADBPNSTWBH6MUXUHTAQ, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.926883730 (296h44m46.523654754s) [noise=true , address=193.149.164.69:4086  , piece_id=64I67SQ7XGQZTXXIM3QEUOZJ3MR4PNYTX2566KYO6XWTKV42N5EA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.932608316 (296h44m46.52937934s) [noise=true , address=79.127.205.235:4263  , piece_id=NOFZRFE2HLK3IQS53AMY3QMBLVQLG5E5QAWVW65JOWSQK7KS6GUQ, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.948627380 (296h44m46.545398406s) [noise=true , address=193.149.164.67:4006  , piece_id=3UBN2ZFDDTC4MEMMCYXZIUW6BGB4XVHS2QRP4UIZULWO35NKSCHQ, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:44:48.960357900 (296h44m46.557128923s) [noise=true , address=193.149.164.68:4041  , piece_id=NU2QPZUVQGH4QIRS4Y2VVJMTTHKCAYHU7JPGBXZJ7TQ6D3C2MRGA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: <nil>
Mar 18 19:45:44.413232108 (296h45m42.01000314s) [noise=true , address=145.79.227.51:4423   , piece_id=NCU3O5HXGX5TTRKKKHGUMTOISBNMQQDBJJTYAAPEF7XFBBDMYPHQ, seg_pos={0 0}, upload=332380]: Done uploading piece. err: ecclient: upload failed (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5, address:145.79.227.51:4423): protocol: rpc: dial tcp 145.79.227.51:4423: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:45:44.413278812 (296h45m42.010049841s) [noise=true , address=145.79.227.41:4100   , piece_id=OXEH6J5B5Y7TFVEBJNMTXN7FJIVU26SQP7UTHY727HBOHOIPASVA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: ecclient: upload failed (node:12JQ78Lg28PborUyvkyLJb5RikJ8zJSAT5GkpYSsZLc6HRmkhyw, address:145.79.227.41:4100): protocol: rpc: dial tcp 145.79.227.41:4100: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:45:44.413562353 (296h45m42.010333388s) [noise=true , address=145.79.227.44:4214   , piece_id=NMUNQCAFF36ERUWCRJW7HQLRZL32VKVE3VVKCYUECXC45YBEJQDA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: ecclient: upload failed (node:12LV4vwjXQvjzxs1jtSpNXZ6VvzLXbQBCYQBn5gzb7jh2DD9qpi, address:145.79.227.44:4214): protocol: rpc: dial tcp 145.79.227.44:4214: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:45:44.413661393 (296h45m42.010432422s) [noise=true , address=145.79.227.36:4541   , piece_id=JCQKPMUEG5DXBBMQCQUOW2DI2BZSOEBPXMIR7EGUBFATY33FYJTA, seg_pos={0 0}, upload=332380]: Done uploading piece. err: ecclient: upload failed (node:1m1ED9th2QhuoxBKEo3Dync9GpkWjGYNTSBHd57ud2BJoH3HXC, address:145.79.227.36:4541): protocol: rpc: dial tcp 145.79.227.36:4541: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:45:44.413723462 (296h45m42.010494495s) [noise=true , address=145.79.227.52:4474   , piece_id=LGOA3K4B53T7G7ZK55WWEINYAOH3C2PKPRNMYNJWRDRE7UXFQY7A, seg_pos={0 0}, upload=332380]: Done uploading piece. err: ecclient: upload failed (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j, address:145.79.227.52:4474): protocol: rpc: dial tcp 145.79.227.52:4474: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Mar 18 19:45:44.413757860 (296h45m42.010528884s) [seg_pos={0 0}, upload=332380]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Mar 18 19:45:47.629192408 (296h45m45.225963438s) [upload=332380]: Done uploading segments...
Mar 18 19:45:47.629238634 (296h45m45.22600966s) [upload=332380]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m3.218845224s core uplink us-select-1 us1-placement-20 metainfo-projects