Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 164365 reports (Page 109 of 3288)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [................................................XXX.........]
duration: 
597.219795ms
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:32:36 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 597.243127ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
8 out of 60 is failed (threshold=3) [.................................................XX..XXXXXX.]
duration: 
1.361250958s
trace: 
https://jaeger.dev.storj.io/trace/64a423e21fced141
FAIL (2025-12-10 23:32:33 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
Dec 10 23:31:24.540013223 (128h3m25.367721614s) [upload=133165]: Starting upload
Dec 10 23:31:24.540058747 (128h3m25.36776713s) [upload=133165]: Done starting upload
Dec 10 23:31:24.540324193 (128h3m25.368032578s) [upload=133165]: Uploading segments...
Dec 10 23:31:24.540365950 (128h3m25.368074346s) [upload=133165]: Got next segment. Inline: false
Dec 10 23:31:24.540400143 (128h3m25.368108534s) [upload=133165]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:31:24.540405098 (128h3m25.368113489s) [upload=133165]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:31:24.585041846 (128h3m25.412750238s) [seg_pos={0 0}, upload=133165]: Begin upload segment...
Dec 10 23:31:24.585097741 (128h3m25.412806134s) [seg_pos={0 0}, upload=133165]: Done begin upload segment.
Dec 10 23:31:24.585131782 (128h3m25.41284018s) [noise=true , address=77.90.31.17:4792     , piece_id=KE3X4F45IY2Z6CXW2V2BQYXSKTBGRM62Z5WSOLGWMWRVFINZDI6Q, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.585213435 (128h3m25.412921826s) [noise=true , address=64.49.13.169:4716    , piece_id=SZXNITITIVOLTJD5QCO2NHOPUEWSFXUEYTIZFHII4ZPF47MVJREQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.586509019 (128h3m25.41421742s) [noise=true , address=45.91.116.7:4023     , piece_id=VQAY2IFXZDXW4ZLV6G44UHZ72PHBJAVROZULINAPGSCG3Q7RRIWQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.586721969 (128h3m25.414430361s) [noise=true , address=145.79.227.41:4116   , piece_id=FE3EBAAXFH7TVMAORVPPCNVKXK4L6UGPEC2NAQOLOSIDXFCJCM3A, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.587477025 (128h3m25.415185422s) [noise=true , address=77.90.31.18:4836     , piece_id=S5Y3UWS6OOS2GWFFOFFCZYYBVQBJA526G7HQZ4TUKA2RPASSOXYQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.587673095 (128h3m25.415381476s) [noise=true , address=77.90.31.11:4573     , piece_id=SQKA2DGAY3ZFMVBNRK64HDEHFIDMEZYZKGZN2I73KVX2GSKCTECA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.588064775 (128h3m25.415773168s) [noise=true , address=145.79.227.30:4773   , piece_id=JE224WLF475BH2OUTIWHJP4MEQDQRVMWRJ5FB7DX3HQNQRX36JXQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.588085418 (128h3m25.415793819s) [noise=true , address=77.90.31.13:4637     , piece_id=COV7RDVWN5SAY4IRUXSVKAI2F24MPVQV66M4V54K4JUCFA7ZXBSA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.588646012 (128h3m25.416354414s) [noise=true , address=145.79.227.24:4599   , piece_id=EJYJJNFFBMTJUU3NKNQNQ4OXIUA4MI5KOO4TQUQH6MZZ6MRXL6TA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.588705466 (128h3m25.416413867s) [noise=true , address=145.79.227.33:4895   , piece_id=GEYFWKWZ6X7ONTNORJABBATKZTT3BDOWFBB5EQSM2J777572MVEA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.589105844 (128h3m25.416814244s) [noise=true , address=77.90.31.11:4566     , piece_id=QYFIHS7HEGLQPQLSOJTC7C6GKAY6WWLYDAICO6DA7RCGNS6PTVGQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.589263271 (128h3m25.416971668s) [noise=true , address=77.90.31.14:4693     , piece_id=LMENV6TJYI3BCYN735ITSWPJVJEEFVHQWHVMCETU6ZZDOGLCJTGA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.589602522 (128h3m25.417310924s) [noise=true , address=145.79.227.39:4025   , piece_id=PHB7QCEAW3KUKTOA6T53WEMNP6PBFJGSEGM6X62ZJNGBOAQ4Z4AQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.590092939 (128h3m25.417801352s) [noise=true , address=77.90.31.21:4886     , piece_id=KRFJZEFRKR2FBGSBTAI4DKLDQNTSEG4NFJL343RXFMJFGV5E3ORA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.590604626 (128h3m25.418313032s) [noise=true , address=5.231.73.2:4035      , piece_id=WAPOLIN7BNUIJHK4SGIF6MBG5UTX4CCHO3HBEVYB6DLS5ZYHTTOQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.591013591 (128h3m25.41872199s) [noise=true , address=77.90.31.21:4908     , piece_id=EQKA5JRAQYQEKPROVYOTM4GFQIBBEK3BGHFJDD6VO64HNH3A324Q, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.591442808 (128h3m25.419151205s) [noise=true , address=45.91.116.14:4199    , piece_id=IFNXQEQTUVJ6CBCNLFHNIE27VTR6K4UIMXXXQEFIBBXTY5NBY3FA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.591809038 (128h3m25.41951743s) [noise=true , address=77.90.31.16:4736     , piece_id=JCD543CFTBRYUBQIZZMGFL7UZJKEGCGU2IYUITLMZMHVXMYKXTLA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.655891403 (128h3m25.483599797s) [upload=133165]: Next returned nil segment
Dec 10 23:31:24.655917650 (128h3m25.483626043s) [upload=133165]: Waiting for error group managing segments...
Dec 10 23:31:24.663303810 (128h3m25.491012203s) [noise=true , address=145.79.227.33:4895   , piece_id=GEYFWKWZ6X7ONTNORJABBATKZTT3BDOWFBB5EQSM2J777572MVEA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.663544159 (128h3m25.491252553s) [noise=true , address=45.91.116.14:4199    , piece_id=IFNXQEQTUVJ6CBCNLFHNIE27VTR6K4UIMXXXQEFIBBXTY5NBY3FA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.663896790 (128h3m25.491605182s) [noise=true , address=145.79.227.39:4025   , piece_id=PHB7QCEAW3KUKTOA6T53WEMNP6PBFJGSEGM6X62ZJNGBOAQ4Z4AQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.665073633 (128h3m25.492782027s) [noise=true , address=145.79.227.41:4116   , piece_id=FE3EBAAXFH7TVMAORVPPCNVKXK4L6UGPEC2NAQOLOSIDXFCJCM3A, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.677381281 (128h3m25.505089673s) [noise=true , address=145.79.227.24:4599   , piece_id=EJYJJNFFBMTJUU3NKNQNQ4OXIUA4MI5KOO4TQUQH6MZZ6MRXL6TA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.687884318 (128h3m25.515592704s) [noise=true , address=45.91.116.7:4023     , piece_id=VQAY2IFXZDXW4ZLV6G44UHZ72PHBJAVROZULINAPGSCG3Q7RRIWQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.783341673 (128h3m25.611050068s) [noise=true , address=5.231.73.2:4035      , piece_id=WAPOLIN7BNUIJHK4SGIF6MBG5UTX4CCHO3HBEVYB6DLS5ZYHTTOQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:25.631085113 (128h3m26.458793507s) [noise=true , address=145.79.227.30:4773   , piece_id=JE224WLF475BH2OUTIWHJP4MEQDQRVMWRJ5FB7DX3HQNQRX36JXQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:30.656938180 (128h3m31.484646571s) [noise=true , address=64.49.13.169:4716    , piece_id=SZXNITITIVOLTJD5QCO2NHOPUEWSFXUEYTIZFHII4ZPF47MVJREQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:32:24.494970227 (128h4m25.322678622s) [noise=true , address=77.90.31.11:4566     , piece_id=QYFIHS7HEGLQPQLSOJTC7C6GKAY6WWLYDAICO6DA7RCGNS6PTVGQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12wYPWKdwDaGih8VSexUfcPyZHEoCMt1VLa3XMXvn9BZtKo7dfk, address:77.90.31.11:4566): protocol: write tcp 159.223.143.39:43548->77.90.31.11:4566: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495103581 (128h4m25.322811979s) [noise=true , address=77.90.31.21:4886     , piece_id=KRFJZEFRKR2FBGSBTAI4DKLDQNTSEG4NFJL343RXFMJFGV5E3ORA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12VMSq3AX3PYjchs8n7yDWVWdKVRUVoe3PiyDitkX1EwSUwsTeM, address:77.90.31.21:4886): protocol: write tcp 159.223.143.39:47614->77.90.31.21:4886: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495298095 (128h4m25.323006563s) [noise=true , address=77.90.31.17:4792     , piece_id=KE3X4F45IY2Z6CXW2V2BQYXSKTBGRM62Z5WSOLGWMWRVFINZDI6Q, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN, address:77.90.31.17:4792): protocol: rpc: dial tcp 77.90.31.17:4792: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495499506 (128h4m25.323207912s) [noise=true , address=77.90.31.18:4836     , piece_id=S5Y3UWS6OOS2GWFFOFFCZYYBVQBJA526G7HQZ4TUKA2RPASSOXYQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv, address:77.90.31.18:4836): protocol: write tcp 159.223.143.39:43794->77.90.31.18:4836: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495729120 (128h4m25.323437519s) [noise=true , address=77.90.31.11:4573     , piece_id=SQKA2DGAY3ZFMVBNRK64HDEHFIDMEZYZKGZN2I73KVX2GSKCTECA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: write tcp 159.223.143.39:49762->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495760253 (128h4m25.323468647s) [noise=true , address=77.90.31.14:4693     , piece_id=LMENV6TJYI3BCYN735ITSWPJVJEEFVHQWHVMCETU6ZZDOGLCJTGA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey, address:77.90.31.14:4693): protocol: write tcp 159.223.143.39:59140->77.90.31.14:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495889551 (128h4m25.323597942s) [noise=true , address=77.90.31.21:4908     , piece_id=EQKA5JRAQYQEKPROVYOTM4GFQIBBEK3BGHFJDD6VO64HNH3A324Q, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:13hCBBV3cxyTWCAuG8QGGAoJRb6S8Ay23HpXYyBgRX4HZSSpga, address:77.90.31.21:4908): protocol: write tcp 159.223.143.39:55630->77.90.31.21:4908: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.496008166 (128h4m25.323716558s) [noise=true , address=77.90.31.16:4736     , piece_id=JCD543CFTBRYUBQIZZMGFL7UZJKEGCGU2IYUITLMZMHVXMYKXTLA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 159.223.143.39:58300->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.496160556 (128h4m25.323868949s) [noise=true , address=77.90.31.13:4637     , piece_id=COV7RDVWN5SAY4IRUXSVKAI2F24MPVQV66M4V54K4JUCFA7ZXBSA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12Myourwn6UnUxVkxzBdRJApeAGNrZzjrgLgzAfki6x9JZ1Fy17, address:77.90.31.13:4637): protocol: write tcp 159.223.143.39:49532->77.90.31.13:4637: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.496186748 (128h4m25.323895133s) [seg_pos={0 0}, upload=133165]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Dec 10 23:32:24.517778689 (128h4m25.345487089s) [upload=133165]: Done uploading segments...
Dec 10 23:32:24.517820506 (128h4m25.345528909s) [upload=133165]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1.361279522s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [..............................................XXX.X.........]
duration: 
454.422193ms
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:32:28 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 454.511948ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
8 out of 60 is failed (threshold=3) [..................................................XX..XXXXXX]
duration: 
1m0.025066078s
trace: 
https://jaeger.dev.storj.io/trace/64a423e21fced141
FAIL (2025-12-10 23:32:24 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
Dec 10 23:31:24.540013223 (128h3m25.367721614s) [upload=133165]: Starting upload
Dec 10 23:31:24.540058747 (128h3m25.36776713s) [upload=133165]: Done starting upload
Dec 10 23:31:24.540324193 (128h3m25.368032578s) [upload=133165]: Uploading segments...
Dec 10 23:31:24.540365950 (128h3m25.368074346s) [upload=133165]: Got next segment. Inline: false
Dec 10 23:31:24.540400143 (128h3m25.368108534s) [upload=133165]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:31:24.540405098 (128h3m25.368113489s) [upload=133165]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:31:24.585041846 (128h3m25.412750238s) [seg_pos={0 0}, upload=133165]: Begin upload segment...
Dec 10 23:31:24.585097741 (128h3m25.412806134s) [seg_pos={0 0}, upload=133165]: Done begin upload segment.
Dec 10 23:31:24.585131782 (128h3m25.41284018s) [noise=true , address=77.90.31.17:4792     , piece_id=KE3X4F45IY2Z6CXW2V2BQYXSKTBGRM62Z5WSOLGWMWRVFINZDI6Q, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.585213435 (128h3m25.412921826s) [noise=true , address=64.49.13.169:4716    , piece_id=SZXNITITIVOLTJD5QCO2NHOPUEWSFXUEYTIZFHII4ZPF47MVJREQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.586509019 (128h3m25.41421742s) [noise=true , address=45.91.116.7:4023     , piece_id=VQAY2IFXZDXW4ZLV6G44UHZ72PHBJAVROZULINAPGSCG3Q7RRIWQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.586721969 (128h3m25.414430361s) [noise=true , address=145.79.227.41:4116   , piece_id=FE3EBAAXFH7TVMAORVPPCNVKXK4L6UGPEC2NAQOLOSIDXFCJCM3A, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.587477025 (128h3m25.415185422s) [noise=true , address=77.90.31.18:4836     , piece_id=S5Y3UWS6OOS2GWFFOFFCZYYBVQBJA526G7HQZ4TUKA2RPASSOXYQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.587673095 (128h3m25.415381476s) [noise=true , address=77.90.31.11:4573     , piece_id=SQKA2DGAY3ZFMVBNRK64HDEHFIDMEZYZKGZN2I73KVX2GSKCTECA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.588064775 (128h3m25.415773168s) [noise=true , address=145.79.227.30:4773   , piece_id=JE224WLF475BH2OUTIWHJP4MEQDQRVMWRJ5FB7DX3HQNQRX36JXQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.588085418 (128h3m25.415793819s) [noise=true , address=77.90.31.13:4637     , piece_id=COV7RDVWN5SAY4IRUXSVKAI2F24MPVQV66M4V54K4JUCFA7ZXBSA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.588646012 (128h3m25.416354414s) [noise=true , address=145.79.227.24:4599   , piece_id=EJYJJNFFBMTJUU3NKNQNQ4OXIUA4MI5KOO4TQUQH6MZZ6MRXL6TA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.588705466 (128h3m25.416413867s) [noise=true , address=145.79.227.33:4895   , piece_id=GEYFWKWZ6X7ONTNORJABBATKZTT3BDOWFBB5EQSM2J777572MVEA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.589105844 (128h3m25.416814244s) [noise=true , address=77.90.31.11:4566     , piece_id=QYFIHS7HEGLQPQLSOJTC7C6GKAY6WWLYDAICO6DA7RCGNS6PTVGQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.589263271 (128h3m25.416971668s) [noise=true , address=77.90.31.14:4693     , piece_id=LMENV6TJYI3BCYN735ITSWPJVJEEFVHQWHVMCETU6ZZDOGLCJTGA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.589602522 (128h3m25.417310924s) [noise=true , address=145.79.227.39:4025   , piece_id=PHB7QCEAW3KUKTOA6T53WEMNP6PBFJGSEGM6X62ZJNGBOAQ4Z4AQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.590092939 (128h3m25.417801352s) [noise=true , address=77.90.31.21:4886     , piece_id=KRFJZEFRKR2FBGSBTAI4DKLDQNTSEG4NFJL343RXFMJFGV5E3ORA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.590604626 (128h3m25.418313032s) [noise=true , address=5.231.73.2:4035      , piece_id=WAPOLIN7BNUIJHK4SGIF6MBG5UTX4CCHO3HBEVYB6DLS5ZYHTTOQ, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.591013591 (128h3m25.41872199s) [noise=true , address=77.90.31.21:4908     , piece_id=EQKA5JRAQYQEKPROVYOTM4GFQIBBEK3BGHFJDD6VO64HNH3A324Q, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.591442808 (128h3m25.419151205s) [noise=true , address=45.91.116.14:4199    , piece_id=IFNXQEQTUVJ6CBCNLFHNIE27VTR6K4UIMXXXQEFIBBXTY5NBY3FA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.591809038 (128h3m25.41951743s) [noise=true , address=77.90.31.16:4736     , piece_id=JCD543CFTBRYUBQIZZMGFL7UZJKEGCGU2IYUITLMZMHVXMYKXTLA, seg_pos={0 0}, upload=133165]: Uploading piece...
Dec 10 23:31:24.655891403 (128h3m25.483599797s) [upload=133165]: Next returned nil segment
Dec 10 23:31:24.655917650 (128h3m25.483626043s) [upload=133165]: Waiting for error group managing segments...
Dec 10 23:31:24.663303810 (128h3m25.491012203s) [noise=true , address=145.79.227.33:4895   , piece_id=GEYFWKWZ6X7ONTNORJABBATKZTT3BDOWFBB5EQSM2J777572MVEA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.663544159 (128h3m25.491252553s) [noise=true , address=45.91.116.14:4199    , piece_id=IFNXQEQTUVJ6CBCNLFHNIE27VTR6K4UIMXXXQEFIBBXTY5NBY3FA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.663896790 (128h3m25.491605182s) [noise=true , address=145.79.227.39:4025   , piece_id=PHB7QCEAW3KUKTOA6T53WEMNP6PBFJGSEGM6X62ZJNGBOAQ4Z4AQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.665073633 (128h3m25.492782027s) [noise=true , address=145.79.227.41:4116   , piece_id=FE3EBAAXFH7TVMAORVPPCNVKXK4L6UGPEC2NAQOLOSIDXFCJCM3A, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.677381281 (128h3m25.505089673s) [noise=true , address=145.79.227.24:4599   , piece_id=EJYJJNFFBMTJUU3NKNQNQ4OXIUA4MI5KOO4TQUQH6MZZ6MRXL6TA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.687884318 (128h3m25.515592704s) [noise=true , address=45.91.116.7:4023     , piece_id=VQAY2IFXZDXW4ZLV6G44UHZ72PHBJAVROZULINAPGSCG3Q7RRIWQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:24.783341673 (128h3m25.611050068s) [noise=true , address=5.231.73.2:4035      , piece_id=WAPOLIN7BNUIJHK4SGIF6MBG5UTX4CCHO3HBEVYB6DLS5ZYHTTOQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:25.631085113 (128h3m26.458793507s) [noise=true , address=145.79.227.30:4773   , piece_id=JE224WLF475BH2OUTIWHJP4MEQDQRVMWRJ5FB7DX3HQNQRX36JXQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:31:30.656938180 (128h3m31.484646571s) [noise=true , address=64.49.13.169:4716    , piece_id=SZXNITITIVOLTJD5QCO2NHOPUEWSFXUEYTIZFHII4ZPF47MVJREQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: <nil>
Dec 10 23:32:24.494970227 (128h4m25.322678622s) [noise=true , address=77.90.31.11:4566     , piece_id=QYFIHS7HEGLQPQLSOJTC7C6GKAY6WWLYDAICO6DA7RCGNS6PTVGQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12wYPWKdwDaGih8VSexUfcPyZHEoCMt1VLa3XMXvn9BZtKo7dfk, address:77.90.31.11:4566): protocol: write tcp 159.223.143.39:43548->77.90.31.11:4566: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495103581 (128h4m25.322811979s) [noise=true , address=77.90.31.21:4886     , piece_id=KRFJZEFRKR2FBGSBTAI4DKLDQNTSEG4NFJL343RXFMJFGV5E3ORA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12VMSq3AX3PYjchs8n7yDWVWdKVRUVoe3PiyDitkX1EwSUwsTeM, address:77.90.31.21:4886): protocol: write tcp 159.223.143.39:47614->77.90.31.21:4886: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495298095 (128h4m25.323006563s) [noise=true , address=77.90.31.17:4792     , piece_id=KE3X4F45IY2Z6CXW2V2BQYXSKTBGRM62Z5WSOLGWMWRVFINZDI6Q, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12SPFgYZnbwjEupjaghfs61qwFM678KNPwpDmRNqV1j2opNgZCN, address:77.90.31.17:4792): protocol: rpc: dial tcp 77.90.31.17:4792: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495499506 (128h4m25.323207912s) [noise=true , address=77.90.31.18:4836     , piece_id=S5Y3UWS6OOS2GWFFOFFCZYYBVQBJA526G7HQZ4TUKA2RPASSOXYQ, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv, address:77.90.31.18:4836): protocol: write tcp 159.223.143.39:43794->77.90.31.18:4836: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495729120 (128h4m25.323437519s) [noise=true , address=77.90.31.11:4573     , piece_id=SQKA2DGAY3ZFMVBNRK64HDEHFIDMEZYZKGZN2I73KVX2GSKCTECA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: write tcp 159.223.143.39:49762->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495760253 (128h4m25.323468647s) [noise=true , address=77.90.31.14:4693     , piece_id=LMENV6TJYI3BCYN735ITSWPJVJEEFVHQWHVMCETU6ZZDOGLCJTGA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:1RASrnvpAj4ToD4xNvbma1iKZEe2uHK8WosjfZwDDom8Qd17Ey, address:77.90.31.14:4693): protocol: write tcp 159.223.143.39:59140->77.90.31.14:4693: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.495889551 (128h4m25.323597942s) [noise=true , address=77.90.31.21:4908     , piece_id=EQKA5JRAQYQEKPROVYOTM4GFQIBBEK3BGHFJDD6VO64HNH3A324Q, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:13hCBBV3cxyTWCAuG8QGGAoJRb6S8Ay23HpXYyBgRX4HZSSpga, address:77.90.31.21:4908): protocol: write tcp 159.223.143.39:55630->77.90.31.21:4908: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.496008166 (128h4m25.323716558s) [noise=true , address=77.90.31.16:4736     , piece_id=JCD543CFTBRYUBQIZZMGFL7UZJKEGCGU2IYUITLMZMHVXMYKXTLA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 159.223.143.39:58300->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.496160556 (128h4m25.323868949s) [noise=true , address=77.90.31.13:4637     , piece_id=COV7RDVWN5SAY4IRUXSVKAI2F24MPVQV66M4V54K4JUCFA7ZXBSA, seg_pos={0 0}, upload=133165]: Done uploading piece. err: ecclient: upload failed (node:12Myourwn6UnUxVkxzBdRJApeAGNrZzjrgLgzAfki6x9JZ1Fy17, address:77.90.31.13:4637): protocol: write tcp 159.223.143.39:49532->77.90.31.13:4637: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:24.496186748 (128h4m25.323895133s) [seg_pos={0 0}, upload=133165]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Dec 10 23:32:24.517778689 (128h4m25.345487089s) [upload=133165]: Done uploading segments...
Dec 10 23:32:24.517820506 (128h4m25.345528909s) [upload=133165]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1m0.025090716s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
8 out of 60 is failed (threshold=3) [...................................................XXXXXXX.X]
duration: 
1m0.027901561s
trace: 
https://jaeger.dev.storj.io/trace/2192a9ff195ecc39
FAIL (2025-12-10 23:32:21 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
82 (128h3m22.252690486s) [noise=true , address=77.90.31.14:4690     , piece_id=CHXSZSFACHZH3VNSLJIPT5PU2UNEPJZDDYDU66HAOQJLDAR5OOCA, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.426075630 (128h3m22.253784021s) [seg_pos={0 0}, upload=133162]: Done begin upload segment.
Dec 10 23:31:21.426129490 (128h3m22.253837887s) [noise=true , address=45.91.116.11:4127    , piece_id=TS5SB7FLEEZL26RGZUH5X7PFDGZLFYKDCCXC4WSRUY56GMEOXSJQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.426158681 (128h3m22.253867083s) [noise=true , address=145.79.227.49:4355   , piece_id=7HGWBTVOIRB3TNNE57PZK4QNTFXQQOLG3BAS4AZJBQNDY7O4PUBQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.426618431 (128h3m22.254326826s) [noise=true , address=145.79.227.29:4953   , piece_id=SQLKG2KAZV5VSDIWEMINI3VYHXUK7QUVMHCH37D6K6ZHOF3FOJQA, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.426625801 (128h3m22.254334179s) [noise=true , address=77.90.31.17:4796     , piece_id=ENSTKQP4K2JBWI4C6QTQYOWKRYPEMDAZVE4W4TGP2BECX37OHZTA, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.426992737 (128h3m22.254701133s) [noise=true , address=77.90.31.19:4868     , piece_id=BI3O7ARVDHQMXLXBHMQOD5YAIQY7ODPEZS2B2NKNTW7G7VARZVHQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.427107483 (128h3m22.254815883s) [noise=true , address=5.231.73.2:4001      , piece_id=ZCOILYNR7MMGQRIRBV5RMVWS4OQFOAMOJWT6WBSIABHUEAAVWIJQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.427368120 (128h3m22.255076517s) [noise=true , address=77.90.31.21:4890     , piece_id=SUXEQK53V3NZOGYVA566JQ2N7XXICOCOBAMGK7SPZK27KYDQA7EQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.427504264 (128h3m22.255212657s) [noise=true , address=45.91.116.12:4230    , piece_id=ZICDEMHWRTCWTMKVD7WXIS5EG36WZACJ6MSY5HBPM67P22ISRLNA, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.427845515 (128h3m22.255553909s) [noise=true , address=145.79.227.33:4899   , piece_id=KDFMCVZNP5PLONMERFNOFZ4SGFDFDX25TTUJ3L5NMLN5GPVEZOTQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.428264562 (128h3m22.25597296s) [noise=true , address=145.79.227.40:4076   , piece_id=EDF5KO3Z3N2AAXQB2T3W3AMZ3CRI57DX6IDA6PMTJFVTHVNZMYYQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.428702055 (128h3m22.256410452s) [noise=true , address=45.91.116.5:4305     , piece_id=FMTFVLTJX6VZN5AGDKV43ABPRG7ZT7MYF4WU2DESXNGOPHHB5BPA, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.429135663 (128h3m22.256844044s) [noise=true , address=5.231.73.4:4013      , piece_id=ETV6SVVORTBUSIPZYCJX25L2OVVY7FB2CMN77W6OKEQG5OZJ7RFQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.429576622 (128h3m22.257285001s) [noise=true , address=77.90.31.16:4763     , piece_id=M6ZC63CV6TYAS6GYTSYKYGGE3NYOWBM3QZOEYJUSCQXI5ZN427PQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.431444638 (128h3m22.25915303s) [noise=true , address=77.90.31.12:4603     , piece_id=R7JBBMKZLLAEMURXAK7GYXZLAE4P7DO32FLEIN6HIAIVV754W2YQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.432006985 (128h3m22.259715386s) [noise=true , address=77.90.31.13:4656     , piece_id=HAQW564VOHYZZQRHEK67MO4Q7AN3P7XFD2MKRI2RRACVLZNEVNFQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.432641663 (128h3m22.26035006s) [noise=true , address=45.91.116.7:4036     , piece_id=6PPBZQ6V2WPX5T5GZA5R57E5XFONRLZHXCQJIEJGQF4A3CSS5PEQ, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.433180705 (128h3m22.2608891s) [noise=true , address=64.49.13.170:4719    , piece_id=YAPIZWA2TGFQWMHWQCBFN7YFMN6UNWBH7BMSB442ZG47RE6XYWUA, seg_pos={0 0}, upload=133162]: Uploading piece...
Dec 10 23:31:21.488477049 (128h3m22.316185427s) [upload=133162]: Next returned nil segment
Dec 10 23:31:21.488507807 (128h3m22.316216209s) [upload=133162]: Waiting for error group managing segments...
Dec 10 23:31:21.493437187 (128h3m22.321145646s) [noise=true , address=45.91.116.12:4230    , piece_id=ZICDEMHWRTCWTMKVD7WXIS5EG36WZACJ6MSY5HBPM67P22ISRLNA, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:21.493788189 (128h3m22.321496582s) [noise=true , address=45.91.116.11:4127    , piece_id=TS5SB7FLEEZL26RGZUH5X7PFDGZLFYKDCCXC4WSRUY56GMEOXSJQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:21.505306471 (128h3m22.333014863s) [noise=true , address=145.79.227.33:4899   , piece_id=KDFMCVZNP5PLONMERFNOFZ4SGFDFDX25TTUJ3L5NMLN5GPVEZOTQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:21.512305631 (128h3m22.340014031s) [noise=true , address=45.91.116.5:4305     , piece_id=FMTFVLTJX6VZN5AGDKV43ABPRG7ZT7MYF4WU2DESXNGOPHHB5BPA, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:21.518738264 (128h3m22.346446667s) [noise=true , address=145.79.227.29:4953   , piece_id=SQLKG2KAZV5VSDIWEMINI3VYHXUK7QUVMHCH37D6K6ZHOF3FOJQA, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:21.524240147 (128h3m22.351948547s) [noise=true , address=145.79.227.49:4355   , piece_id=7HGWBTVOIRB3TNNE57PZK4QNTFXQQOLG3BAS4AZJBQNDY7O4PUBQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:21.525088237 (128h3m22.35279664s) [noise=true , address=45.91.116.7:4036     , piece_id=6PPBZQ6V2WPX5T5GZA5R57E5XFONRLZHXCQJIEJGQF4A3CSS5PEQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:21.537874559 (128h3m22.365582955s) [noise=true , address=145.79.227.40:4076   , piece_id=EDF5KO3Z3N2AAXQB2T3W3AMZ3CRI57DX6IDA6PMTJFVTHVNZMYYQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:21.642412172 (128h3m22.470120569s) [noise=true , address=5.231.73.2:4001      , piece_id=ZCOILYNR7MMGQRIRBV5RMVWS4OQFOAMOJWT6WBSIABHUEAAVWIJQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:21.729209356 (128h3m22.556917748s) [noise=true , address=5.231.73.4:4013      , piece_id=ETV6SVVORTBUSIPZYCJX25L2OVVY7FB2CMN77W6OKEQG5OZJ7RFQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:31:22.099199110 (128h3m22.926907501s) [noise=true , address=64.49.13.170:4719    , piece_id=YAPIZWA2TGFQWMHWQCBFN7YFMN6UNWBH7BMSB442ZG47RE6XYWUA, seg_pos={0 0}, upload=133162]: Done uploading piece. err: <nil>
Dec 10 23:32:21.365787751 (128h4m22.19349615s) [noise=true , address=77.90.31.13:4656     , piece_id=HAQW564VOHYZZQRHEK67MO4Q7AN3P7XFD2MKRI2RRACVLZNEVNFQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: rpc: dial tcp 77.90.31.13:4656: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:21.366117827 (128h4m22.193826221s) [noise=true , address=77.90.31.16:4763     , piece_id=M6ZC63CV6TYAS6GYTSYKYGGE3NYOWBM3QZOEYJUSCQXI5ZN427PQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: ecclient: upload failed (node:12Bn4bKB4U5JidFqnXuPTncmNPGi72tgbL5YmYBRbbJ6ckqo35d, address:77.90.31.16:4763): protocol: write tcp 159.223.143.39:47352->77.90.31.16:4763: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:21.366277667 (128h4m22.193986058s) [noise=true , address=77.90.31.14:4690     , piece_id=CHXSZSFACHZH3VNSLJIPT5PU2UNEPJZDDYDU66HAOQJLDAR5OOCA, seg_pos={0 0}, upload=133162]: Done uploading piece. err: ecclient: upload failed (node:1WPKeCcN1uEhGjZHAJgCoJMaHxAWouGCdaU1vZwAS7kX22rxcv, address:77.90.31.14:4690): protocol: rpc: dial tcp 77.90.31.14:4690: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:21.366292615 (128h4m22.194000996s) [noise=true , address=77.90.31.21:4890     , piece_id=SUXEQK53V3NZOGYVA566JQ2N7XXICOCOBAMGK7SPZK27KYDQA7EQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: ecclient: upload failed (node:1iE3mDnEhGDsMBtmUXC4EwvSrpyHLoybzVXkC9eoFuYEMHeBrd, address:77.90.31.21:4890): protocol: write tcp 159.223.143.39:50104->77.90.31.21:4890: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:21.366438960 (128h4m22.194147354s) [noise=true , address=77.90.31.19:4868     , piece_id=BI3O7ARVDHQMXLXBHMQOD5YAIQY7ODPEZS2B2NKNTW7G7VARZVHQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: ecclient: upload failed (node:17DGGjPv2UkSCAH8ihb4U7CX2K5mYmPjumSSKc26sbcscrjQX1, address:77.90.31.19:4868): protocol: rpc: dial tcp 77.90.31.19:4868: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:21.366490802 (128h4m22.194199214s) [noise=true , address=77.90.31.12:4603     , piece_id=R7JBBMKZLLAEMURXAK7GYXZLAE4P7DO32FLEIN6HIAIVV754W2YQ, seg_pos={0 0}, upload=133162]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: write tcp 159.223.143.39:52570->77.90.31.12:4603: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:21.366785902 (128h4m22.194494303s) [noise=true , address=77.90.31.17:4796     , piece_id=ENSTKQP4K2JBWI4C6QTQYOWKRYPEMDAZVE4W4TGP2BECX37OHZTA, seg_pos={0 0}, upload=133162]: Done uploading piece. err: ecclient: upload failed (node:1KK6y5NBuZovne8n3gMvAyDcZFasZxDzorvPeHe7CefoFs27UF, address:77.90.31.17:4796): protocol: rpc: dial tcp 77.90.31.17:4796: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:32:21.366820298 (128h4m22.194528681s) [seg_pos={0 0}, upload=133162]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Dec 10 23:32:21.390771313 (128h4m22.218479693s) [upload=133162]: Done uploading segments...
Dec 10 23:32:21.390820394 (128h4m22.218528785s) [upload=133162]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 1m0.027924124s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [...............................................X....X...X...]
duration: 
447.887804ms
trace: 
https://jaeger.dev.storj.io/trace/749247032308b962
FAIL (2025-12-10 23:32:12 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 447.915189ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [...............................................XXX.X........]
duration: 
478.462849ms
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:32:00 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 478.492244ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [................................................X....X...X..]
duration: 
443.315421ms
trace: 
https://jaeger.dev.storj.io/trace/749247032308b962
FAIL (2025-12-10 23:31:42 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 443.423302ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [.................................................X....X...X.]
duration: 
490.724115ms
trace: 
https://jaeger.dev.storj.io/trace/749247032308b962
FAIL (2025-12-10 23:31:25 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 490.743055ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [.................................................XXX........]
duration: 
623.522876ms
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:31:25 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 623.573654ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
7 out of 60 is failed (threshold=3) [...................................................XX..XXXXX]
duration: 
1m0.027381573s
trace: 
https://jaeger.dev.storj.io/trace/283069a05fbb2fb5
FAIL (2025-12-10 23:31:13 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 10)
======LOGS======
Dec 10 23:30:13.537123792 (128h2m14.364832306s) [upload=133144]: Starting upload
Dec 10 23:30:13.537209172 (128h2m14.364917566s) [upload=133144]: Done starting upload
Dec 10 23:30:13.537504012 (128h2m14.365212393s) [upload=133144]: Uploading segments...
Dec 10 23:30:13.537556349 (128h2m14.36526474s) [upload=133144]: Got next segment. Inline: false
Dec 10 23:30:13.537586684 (128h2m14.365295069s) [upload=133144]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:30:13.537591639 (128h2m14.36530003s) [upload=133144]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:30:13.568788972 (128h2m14.39649737s) [seg_pos={0 0}, upload=133144]: Begin upload segment...
Dec 10 23:30:13.568881409 (128h2m14.396589808s) [seg_pos={0 0}, upload=133144]: Done begin upload segment.
Dec 10 23:30:13.568965066 (128h2m14.396673468s) [noise=true , address=77.90.31.15:4732     , piece_id=RAWMI26SC5KQQSYBLVFHKSGBQPKXPK5PKUBAUA2HRNOCE5VYQSHQ, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.569261659 (128h2m14.396970061s) [noise=true , address=77.90.31.17:4778     , piece_id=7VP4J2KYFPZORVYXP7YYZWSEI6LDT7YULRN6E7X5HUN4UYYCNSLA, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.570417020 (128h2m14.398125421s) [noise=true , address=145.79.227.30:4767   , piece_id=LHJNFPMORLYVJSA5TFO6L6GSOMBXRLIKEVTKPUQFPUHIUVLB67SQ, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.570853219 (128h2m14.398561611s) [noise=true , address=77.90.31.11:4566     , piece_id=U2JNWPLIJSIZN3E2D5ANM63P5W5CV6LGGC6ST3CTEXQXPYYGE4FQ, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.571359012 (128h2m14.399067403s) [noise=true , address=145.79.227.9:4373    , piece_id=GQNXLHKUPT4LJNZF4LKXJBDAG3UHABV32DQWH37LDRBMFXHCD3HQ, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.571540369 (128h2m14.39924877s) [noise=true , address=77.90.31.18:4839     , piece_id=43VLGELLR5Q52CK2UEH74ACGTPAORBYYVPNRTNHZ4K7I52EJXUIA, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.571818612 (128h2m14.399527009s) [noise=true , address=145.79.227.16:4914   , piece_id=JJ6CB3WI656Q7GVYCTMGDY2XLBXTW2Z5T2NPXUGB7BAPOGUL7O4Q, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.571981111 (128h2m14.399689509s) [noise=true , address=77.90.31.14:4679     , piece_id=X3YEHDULWWSOFJ5VPWF3OSHI5VFVOCI4GGI5EREODSY5KQLLYD7Q, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.572398449 (128h2m14.40010684s) [noise=true , address=45.91.116.12:4230    , piece_id=DREXCAQIPMVQQLVOJPOOSFAFF6JMMFYYCDJLLM35K45WCBUYAXQQ, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.572456125 (128h2m14.400164523s) [noise=true , address=145.79.227.47:4279   , piece_id=5ROUU4QE6NY2CGR2DGHFYC6FUSCEY532OUQL3WUU6MQRI42HLI6Q, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.572870301 (128h2m14.400578703s) [noise=true , address=145.79.227.20:4460   , piece_id=RLSQ7RIBI2ZO7XU36SRSIVCCB34K6TJVRHCRXHLUEQL7R2KCTSIQ, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.573014137 (128h2m14.400722531s) [noise=true , address=45.91.116.13:4187    , piece_id=4LOE53VELLEC73UZX27YOVBIIJSFIHBXSDSBFLKO67P655ZCQK6Q, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.573290361 (128h2m14.400998755s) [noise=true , address=5.231.73.2:4028      , piece_id=GESKY6PTLWCZYXSJERHGO53YGAOHXIPHGNPCG6JYCTQED4FMUTEA, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.573662422 (128h2m14.401370813s) [noise=true , address=77.90.31.19:4872     , piece_id=DI2DWS4EKW7VPJ2PKTMVWJU7G4MMGTVSEUY662HZLUTVPK7ENH4Q, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.573904394 (128h2m14.401612794s) [noise=true , address=5.231.73.5:4019      , piece_id=NC5O77XCMWCV54PJSFTYG2E4CZAGX5SHFLHL4XVGKQQK5MGG2MKA, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.574257386 (128h2m14.401965783s) [noise=true , address=5.231.73.4:4016      , piece_id=MHJ4I4WUD23CVVHYZNGPGE4GSR53IZIRCMHXAAADBQM5D4N7DLYA, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.574593992 (128h2m14.402302383s) [noise=true , address=77.90.31.19:4875     , piece_id=TBVIESF7KCOV2R3IKAHQB6NDQHNJAW2MASQYW4ZTPWCIMCWBIEPQ, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.575001831 (128h2m14.402710225s) [noise=true , address=77.90.31.21:4894     , piece_id=JQBCBDNY47OGVVQZZNTEJOENEF4CAPBQM53PAERC45BCICTG7F4A, seg_pos={0 0}, upload=133144]: Uploading piece...
Dec 10 23:30:13.646716537 (128h2m14.474424928s) [upload=133144]: Next returned nil segment
Dec 10 23:30:13.646733399 (128h2m14.47444178s) [upload=133144]: Waiting for error group managing segments...
Dec 10 23:30:13.652723105 (128h2m14.480431486s) [noise=true , address=145.79.227.20:4460   , piece_id=RLSQ7RIBI2ZO7XU36SRSIVCCB34K6TJVRHCRXHLUEQL7R2KCTSIQ, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:30:13.652977855 (128h2m14.480686252s) [noise=true , address=145.79.227.9:4373    , piece_id=GQNXLHKUPT4LJNZF4LKXJBDAG3UHABV32DQWH37LDRBMFXHCD3HQ, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:30:13.677147696 (128h2m14.504856092s) [noise=true , address=45.91.116.12:4230    , piece_id=DREXCAQIPMVQQLVOJPOOSFAFF6JMMFYYCDJLLM35K45WCBUYAXQQ, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:30:13.681451904 (128h2m14.509160307s) [noise=true , address=145.79.227.47:4279   , piece_id=5ROUU4QE6NY2CGR2DGHFYC6FUSCEY532OUQL3WUU6MQRI42HLI6Q, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:30:13.697518378 (128h2m14.525226769s) [noise=true , address=45.91.116.13:4187    , piece_id=4LOE53VELLEC73UZX27YOVBIIJSFIHBXSDSBFLKO67P655ZCQK6Q, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:30:13.745425143 (128h2m14.573133534s) [noise=true , address=5.231.73.4:4016      , piece_id=MHJ4I4WUD23CVVHYZNGPGE4GSR53IZIRCMHXAAADBQM5D4N7DLYA, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:30:13.749006074 (128h2m14.576714465s) [noise=true , address=5.231.73.2:4028      , piece_id=GESKY6PTLWCZYXSJERHGO53YGAOHXIPHGNPCG6JYCTQED4FMUTEA, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:30:13.754276577 (128h2m14.581984974s) [noise=true , address=5.231.73.5:4019      , piece_id=NC5O77XCMWCV54PJSFTYG2E4CZAGX5SHFLHL4XVGKQQK5MGG2MKA, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:30:14.653507747 (128h2m15.481216139s) [noise=true , address=145.79.227.30:4767   , piece_id=LHJNFPMORLYVJSA5TFO6L6GSOMBXRLIKEVTKPUQFPUHIUVLB67SQ, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:30:14.739683229 (128h2m15.567391626s) [noise=true , address=145.79.227.16:4914   , piece_id=JJ6CB3WI656Q7GVYCTMGDY2XLBXTW2Z5T2NPXUGB7BAPOGUL7O4Q, seg_pos={0 0}, upload=133144]: Done uploading piece. err: <nil>
Dec 10 23:31:13.495542175 (128h3m14.323250577s) [noise=true , address=77.90.31.17:4778     , piece_id=7VP4J2KYFPZORVYXP7YYZWSEI6LDT7YULRN6E7X5HUN4UYYCNSLA, seg_pos={0 0}, upload=133144]: Done uploading piece. err: ecclient: upload failed (node:12icjsyKdwPqDddPbEZpCJvX1pxmTLSy8ZfFUMCJU1SxPsKGdZo, address:77.90.31.17:4778): protocol: rpc: dial tcp 77.90.31.17:4778: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:31:13.495664483 (128h3m14.323372883s) [noise=true , address=77.90.31.19:4872     , piece_id=DI2DWS4EKW7VPJ2PKTMVWJU7G4MMGTVSEUY662HZLUTVPK7ENH4Q, seg_pos={0 0}, upload=133144]: Done uploading piece. err: ecclient: upload failed (node:127ckxo8rSfJjtVZHEquzgsHGG78DiyoSRdqykfrzbfw1n5tfWL, address:77.90.31.19:4872): protocol: write tcp 159.223.143.39:56778->77.90.31.19:4872: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:31:13.495902256 (128h3m14.323610661s) [noise=true , address=77.90.31.19:4875     , piece_id=TBVIESF7KCOV2R3IKAHQB6NDQHNJAW2MASQYW4ZTPWCIMCWBIEPQ, seg_pos={0 0}, upload=133144]: Done uploading piece. err: ecclient: upload failed (node:1xSFQaW3aVnAVDYE5r5ADmCGU95vWnshuZyte32W2YAj94avNn, address:77.90.31.19:4875): protocol: rpc: dial tcp 77.90.31.19:4875: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:31:13.495990543 (128h3m14.323698946s) [noise=true , address=77.90.31.15:4732     , piece_id=RAWMI26SC5KQQSYBLVFHKSGBQPKXPK5PKUBAUA2HRNOCE5VYQSHQ, seg_pos={0 0}, upload=133144]: Done uploading piece. err: ecclient: upload failed (node:1NyFYdUBbAhAijCDtPWB1zJCjwhgw35vEQoE4qJyg2PywRn5AH, address:77.90.31.15:4732): protocol: rpc: dial tcp 77.90.31.15:4732: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:31:13.496250679 (128h3m14.323959083s) [noise=true , address=77.90.31.11:4566     , piece_id=U2JNWPLIJSIZN3E2D5ANM63P5W5CV6LGGC6ST3CTEXQXPYYGE4FQ, seg_pos={0 0}, upload=133144]: Done uploading piece. err: ecclient: upload failed (node:12wYPWKdwDaGih8VSexUfcPyZHEoCMt1VLa3XMXvn9BZtKo7dfk, address:77.90.31.11:4566): protocol: rpc: dial tcp 77.90.31.11:4566: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:31:13.496340685 (128h3m14.324049089s) [noise=true , address=77.90.31.18:4839     , piece_id=43VLGELLR5Q52CK2UEH74ACGTPAORBYYVPNRTNHZ4K7I52EJXUIA, seg_pos={0 0}, upload=133144]: Done uploading piece. err: ecclient: upload failed (node:1gmWwyaQ6zM6QdayBFpXdE9VSE1aaQcBHFcukJoASjjHWCDsNx, address:77.90.31.18:4839): protocol: rpc: dial tcp 77.90.31.18:4839: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:31:13.496471093 (128h3m14.324179491s) [noise=true , address=77.90.31.21:4894     , piece_id=JQBCBDNY47OGVVQZZNTEJOENEF4CAPBQM53PAERC45BCICTG7F4A, seg_pos={0 0}, upload=133144]: Done uploading piece. err: ecclient: upload failed (node:1JJ81nDtVEinZaEU7NM7AAhCWiFN7V6a8o5Cp9ZzWjvjDCKmMG, address:77.90.31.21:4894): protocol: write tcp 159.223.143.39:53556->77.90.31.21:4894: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:31:13.496745651 (128h3m14.324454048s) [noise=true , address=77.90.31.14:4679     , piece_id=X3YEHDULWWSOFJ5VPWF3OSHI5VFVOCI4GGI5EREODSY5KQLLYD7Q, seg_pos={0 0}, upload=133144]: Done uploading piece. err: ecclient: upload failed (node:1k29MGpez3ByMHnG8qGBm9iPwo3VrKUGDHpz9CqGEGNn47rxDx, address:77.90.31.14:4679): protocol: rpc: dial tcp 77.90.31.14:4679: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:31:13.496779461 (128h3m14.324487853s) [seg_pos={0 0}, upload=133144]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil>
Dec 10 23:31:13.520242489 (128h3m14.347950893s) [upload=133144]: Done uploading segments...
Dec 10 23:31:13.520299634 (128h3m14.348008033s) [upload=133144]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10)
Duration: 1m0.027400277s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [................................................XXX.X.......]
duration: 
497.76971ms
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:31:02 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 497.8049ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [..................................................X....X...X]
duration: 
30.000913225s
trace: 
https://jaeger.dev.storj.io/trace/749247032308b962
FAIL (2025-12-10 23:30:58 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000935341s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [..................................................XXX.......]
duration: 
755.111417ms
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:30:57 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 755.139948ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [.................................................XXX.X......]
duration: 
469.180977ms
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:30:44 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 469.212393ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
7 out of 60 is failed (threshold=3) [....................................................XXXXXXX.]
duration: 
6.808415742s
trace: 
https://jaeger.dev.storj.io/trace/18d6d49267057b3
FAIL (2025-12-10 23:30:28 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
_SegmentBegin
Dec 10 23:29:21.382860291 (128h1m22.210568693s) [seg_pos={0 0}, upload=133132]: Begin upload segment...
Dec 10 23:29:21.382934536 (128h1m22.210642928s) [seg_pos={0 0}, upload=133132]: Done begin upload segment.
Dec 10 23:29:21.382971634 (128h1m22.210680035s) [noise=true , address=45.91.116.6:4976     , piece_id=PJNC5BX5PTUVKJUYZIY35KYCMKTWGAWSXI3GRCXRQSPG7MARMPSQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.383130600 (128h1m22.210839s) [noise=true , address=45.91.116.11:4141    , piece_id=2X4A55TZ3XEDYIBDZNUMPT7UYKNH4LCNPK77M37SSUSYJFKOC3HQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.383726381 (128h1m22.211434777s) [noise=true , address=145.79.227.15:4887   , piece_id=D5KQQB6K746ONSSPG2AYAG7Z2LTTDB5SCUIZN4DGJ3WM2XCNWQ3Q, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.383848879 (128h1m22.211557279s) [noise=true , address=77.90.31.16:4736     , piece_id=ECKNYKLH7KMOF6DDDXY3DGA6DCIQVGFH453ANA4TEWBITC53CEBA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384196108 (128h1m22.211904507s) [noise=true , address=145.79.227.28:4755   , piece_id=3LAPEHXG2LTIDBMIQ6UYWIBFKEPKJSGYFDFXO57AVM7JAOZHFPVQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384242186 (128h1m22.211950581s) [noise=true , address=77.90.31.21:4909     , piece_id=NSRO6F674XMDA42UELXTH3VRGIPM4ZX5ACJYRRTYVIEGHBFQABTQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384662574 (128h1m22.212370971s) [noise=true , address=145.79.227.44:4200   , piece_id=3NFBD7AG3BILIKYPJ55UFD75MDD2EOKSLRZGVP5X4F4CPDVZSBKQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384682701 (128h1m22.212391098s) [noise=true , address=145.79.227.2:4137    , piece_id=GYM6LUNOI2YNEF4MA2GNV6ORSEXAKPYESBJF5VNOXOKH7WGE4YLA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384991733 (128h1m22.212700127s) [noise=true , address=77.90.31.19:4869     , piece_id=625UNSZHDY2DG3MOO27DDY53QJFWVNYDIAEZ4FT4GLIY3VHVVCKA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385032671 (128h1m22.212741069s) [noise=true , address=45.91.116.10:4087    , piece_id=4VPKXU7NHUC25NWJHJ4TVSMNRADPVGJC4AGVUDUBEXARZIJCB5UA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385254982 (128h1m22.212963373s) [noise=true , address=145.79.227.21:4476   , piece_id=XJWHM43B7XEEDLM4GLILTJ3EO7FLIYU7NMXAL53FE47Z2D3VYRRA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385350902 (128h1m22.213059296s) [noise=true , address=45.91.116.4:4962     , piece_id=LZDUUTUUN4SZZDCPPDDT4LBFO7IH3WHQNXVY2TSK7Z5543ELZPEA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385540403 (128h1m22.213248805s) [noise=true , address=145.79.227.26:4674   , piece_id=3253RHRC2DXRDATZ5D2RBTSQMI3ZUBH6L4HMFWK62WC7HJXEMTDA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385680790 (128h1m22.21338918s) [noise=true , address=77.90.31.17:4790     , piece_id=IPVMHL4COMOCX2QMOV22J4SATAZQ73E27WW73KCZQSO6BO7ATAAQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385993534 (128h1m22.213701912s) [noise=true , address=77.90.31.13:4642     , piece_id=AZ5ZTA3LP3MAUNCRYI2DW5RBJALL3GARN2MH3NCP5DYTLDTYJDIQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.386312049 (128h1m22.214020449s) [noise=true , address=77.90.31.12:4610     , piece_id=7VW2BQWODDIUL3HZD6F3AMOZ7XKOCOGZKFAPOTS7J5ZHLDJ5A3TQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.386636584 (128h1m22.214344977s) [noise=true , address=45.91.116.5:4305     , piece_id=XFSYEUTFVJF7FWKNYPK2IX2ELLD4N3XIPKB226YLD4DZ5DLTCXOQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.386958276 (128h1m22.214666674s) [noise=true , address=45.91.116.11:4126    , piece_id=Z5VTXSRK5YYI5UK3GSN62ABAEAATSUZEFWLASM4QAKQCYKIVQVQQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.448072253 (128h1m22.275780636s) [upload=133132]: Next returned nil segment
Dec 10 23:29:21.448085474 (128h1m22.275793857s) [upload=133132]: Waiting for error group managing segments...
Dec 10 23:29:21.454245195 (128h1m22.28195359s) [noise=true , address=45.91.116.6:4976     , piece_id=PJNC5BX5PTUVKJUYZIY35KYCMKTWGAWSXI3GRCXRQSPG7MARMPSQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.454809355 (128h1m22.282517754s) [noise=true , address=45.91.116.4:4962     , piece_id=LZDUUTUUN4SZZDCPPDDT4LBFO7IH3WHQNXVY2TSK7Z5543ELZPEA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.454995842 (128h1m22.282704239s) [noise=true , address=45.91.116.10:4087    , piece_id=4VPKXU7NHUC25NWJHJ4TVSMNRADPVGJC4AGVUDUBEXARZIJCB5UA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.455561273 (128h1m22.28326967s) [noise=true , address=145.79.227.15:4887   , piece_id=D5KQQB6K746ONSSPG2AYAG7Z2LTTDB5SCUIZN4DGJ3WM2XCNWQ3Q, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.455762939 (128h1m22.283471334s) [noise=true , address=145.79.227.21:4476   , piece_id=XJWHM43B7XEEDLM4GLILTJ3EO7FLIYU7NMXAL53FE47Z2D3VYRRA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.456558891 (128h1m22.284267283s) [noise=true , address=45.91.116.11:4126    , piece_id=Z5VTXSRK5YYI5UK3GSN62ABAEAATSUZEFWLASM4QAKQCYKIVQVQQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.464406476 (128h1m22.292114868s) [noise=true , address=145.79.227.26:4674   , piece_id=3253RHRC2DXRDATZ5D2RBTSQMI3ZUBH6L4HMFWK62WC7HJXEMTDA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.473112023 (128h1m22.300820413s) [noise=true , address=45.91.116.11:4141    , piece_id=2X4A55TZ3XEDYIBDZNUMPT7UYKNH4LCNPK77M37SSUSYJFKOC3HQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.473609731 (128h1m22.301318129s) [noise=true , address=145.79.227.28:4755   , piece_id=3LAPEHXG2LTIDBMIQ6UYWIBFKEPKJSGYFDFXO57AVM7JAOZHFPVQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.476565614 (128h1m22.30427401s) [noise=true , address=45.91.116.5:4305     , piece_id=XFSYEUTFVJF7FWKNYPK2IX2ELLD4N3XIPKB226YLD4DZ5DLTCXOQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.479313327 (128h1m22.307021721s) [noise=true , address=145.79.227.2:4137    , piece_id=GYM6LUNOI2YNEF4MA2GNV6ORSEXAKPYESBJF5VNOXOKH7WGE4YLA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:22.605851230 (128h1m23.433559623s) [noise=true , address=145.79.227.44:4200   , piece_id=3NFBD7AG3BILIKYPJ55UFD75MDD2EOKSLRZGVP5X4F4CPDVZSBKQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:30:21.319245769 (128h2m22.146954166s) [noise=true , address=77.90.31.13:4642     , piece_id=AZ5ZTA3LP3MAUNCRYI2DW5RBJALL3GARN2MH3NCP5DYTLDTYJDIQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:1xdfVQUEMLaGgw7hsBtHZVTKL9BTTxPeYve53efw8GPdSQDL9D, address:77.90.31.13:4642): protocol: write tcp 159.223.143.39:34630->77.90.31.13:4642: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.319416400 (128h2m22.147124797s) [noise=true , address=77.90.31.17:4790     , piece_id=IPVMHL4COMOCX2QMOV22J4SATAZQ73E27WW73KCZQSO6BO7ATAAQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:1vDiVaJCoCnC6GqF5ZjhVwA6QCo1HkvRDYqLhEfKM8z91bv25b, address:77.90.31.17:4790): protocol: write tcp 159.223.143.39:38620->77.90.31.17:4790: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.319428872 (128h2m22.147137266s) [noise=true , address=77.90.31.16:4736     , piece_id=ECKNYKLH7KMOF6DDDXY3DGA6DCIQVGFH453ANA4TEWBITC53CEBA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 159.223.143.39:38308->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.319579167 (128h2m22.147287564s) [noise=true , address=77.90.31.21:4909     , piece_id=NSRO6F674XMDA42UELXTH3VRGIPM4ZX5ACJYRRTYVIEGHBFQABTQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6, address:77.90.31.21:4909): protocol: write tcp 159.223.143.39:57154->77.90.31.21:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.319639235 (128h2m22.147347633s) [noise=true , address=77.90.31.12:4610     , piece_id=7VW2BQWODDIUL3HZD6F3AMOZ7XKOCOGZKFAPOTS7J5ZHLDJ5A3TQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:12aJUUvWNCYSbhTkNgjAj6FPXK5LK2qdHDqntvrVabGwD2BhsYi, address:77.90.31.12:4610): protocol: write tcp 159.223.143.39:54152->77.90.31.12:4610: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.320713981 (128h2m22.148422373s) [noise=true , address=77.90.31.19:4869     , piece_id=625UNSZHDY2DG3MOO27DDY53QJFWVNYDIAEZ4FT4GLIY3VHVVCKA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8, address:77.90.31.19:4869): protocol: write tcp 159.223.143.39:36304->77.90.31.19:4869: use of closed network connection; context deadline exceeded
Dec 10 23:30:21.320782840 (128h2m22.148491235s) [seg_pos={0 0}, upload=133132]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Dec 10 23:30:21.341189888 (128h2m22.168898283s) [upload=133132]: Done uploading segments...
Dec 10 23:30:21.341230070 (128h2m22.168938462s) [upload=133132]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 6.808437576s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX]
duration: 
1m0.024860412s
trace: 
https://jaeger.dev.storj.io/trace/18d6d49267057b3
FAIL (2025-12-10 23:30:21 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
_SegmentBegin
Dec 10 23:29:21.382860291 (128h1m22.210568693s) [seg_pos={0 0}, upload=133132]: Begin upload segment...
Dec 10 23:29:21.382934536 (128h1m22.210642928s) [seg_pos={0 0}, upload=133132]: Done begin upload segment.
Dec 10 23:29:21.382971634 (128h1m22.210680035s) [noise=true , address=45.91.116.6:4976     , piece_id=PJNC5BX5PTUVKJUYZIY35KYCMKTWGAWSXI3GRCXRQSPG7MARMPSQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.383130600 (128h1m22.210839s) [noise=true , address=45.91.116.11:4141    , piece_id=2X4A55TZ3XEDYIBDZNUMPT7UYKNH4LCNPK77M37SSUSYJFKOC3HQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.383726381 (128h1m22.211434777s) [noise=true , address=145.79.227.15:4887   , piece_id=D5KQQB6K746ONSSPG2AYAG7Z2LTTDB5SCUIZN4DGJ3WM2XCNWQ3Q, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.383848879 (128h1m22.211557279s) [noise=true , address=77.90.31.16:4736     , piece_id=ECKNYKLH7KMOF6DDDXY3DGA6DCIQVGFH453ANA4TEWBITC53CEBA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384196108 (128h1m22.211904507s) [noise=true , address=145.79.227.28:4755   , piece_id=3LAPEHXG2LTIDBMIQ6UYWIBFKEPKJSGYFDFXO57AVM7JAOZHFPVQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384242186 (128h1m22.211950581s) [noise=true , address=77.90.31.21:4909     , piece_id=NSRO6F674XMDA42UELXTH3VRGIPM4ZX5ACJYRRTYVIEGHBFQABTQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384662574 (128h1m22.212370971s) [noise=true , address=145.79.227.44:4200   , piece_id=3NFBD7AG3BILIKYPJ55UFD75MDD2EOKSLRZGVP5X4F4CPDVZSBKQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384682701 (128h1m22.212391098s) [noise=true , address=145.79.227.2:4137    , piece_id=GYM6LUNOI2YNEF4MA2GNV6ORSEXAKPYESBJF5VNOXOKH7WGE4YLA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.384991733 (128h1m22.212700127s) [noise=true , address=77.90.31.19:4869     , piece_id=625UNSZHDY2DG3MOO27DDY53QJFWVNYDIAEZ4FT4GLIY3VHVVCKA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385032671 (128h1m22.212741069s) [noise=true , address=45.91.116.10:4087    , piece_id=4VPKXU7NHUC25NWJHJ4TVSMNRADPVGJC4AGVUDUBEXARZIJCB5UA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385254982 (128h1m22.212963373s) [noise=true , address=145.79.227.21:4476   , piece_id=XJWHM43B7XEEDLM4GLILTJ3EO7FLIYU7NMXAL53FE47Z2D3VYRRA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385350902 (128h1m22.213059296s) [noise=true , address=45.91.116.4:4962     , piece_id=LZDUUTUUN4SZZDCPPDDT4LBFO7IH3WHQNXVY2TSK7Z5543ELZPEA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385540403 (128h1m22.213248805s) [noise=true , address=145.79.227.26:4674   , piece_id=3253RHRC2DXRDATZ5D2RBTSQMI3ZUBH6L4HMFWK62WC7HJXEMTDA, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385680790 (128h1m22.21338918s) [noise=true , address=77.90.31.17:4790     , piece_id=IPVMHL4COMOCX2QMOV22J4SATAZQ73E27WW73KCZQSO6BO7ATAAQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.385993534 (128h1m22.213701912s) [noise=true , address=77.90.31.13:4642     , piece_id=AZ5ZTA3LP3MAUNCRYI2DW5RBJALL3GARN2MH3NCP5DYTLDTYJDIQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.386312049 (128h1m22.214020449s) [noise=true , address=77.90.31.12:4610     , piece_id=7VW2BQWODDIUL3HZD6F3AMOZ7XKOCOGZKFAPOTS7J5ZHLDJ5A3TQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.386636584 (128h1m22.214344977s) [noise=true , address=45.91.116.5:4305     , piece_id=XFSYEUTFVJF7FWKNYPK2IX2ELLD4N3XIPKB226YLD4DZ5DLTCXOQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.386958276 (128h1m22.214666674s) [noise=true , address=45.91.116.11:4126    , piece_id=Z5VTXSRK5YYI5UK3GSN62ABAEAATSUZEFWLASM4QAKQCYKIVQVQQ, seg_pos={0 0}, upload=133132]: Uploading piece...
Dec 10 23:29:21.448072253 (128h1m22.275780636s) [upload=133132]: Next returned nil segment
Dec 10 23:29:21.448085474 (128h1m22.275793857s) [upload=133132]: Waiting for error group managing segments...
Dec 10 23:29:21.454245195 (128h1m22.28195359s) [noise=true , address=45.91.116.6:4976     , piece_id=PJNC5BX5PTUVKJUYZIY35KYCMKTWGAWSXI3GRCXRQSPG7MARMPSQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.454809355 (128h1m22.282517754s) [noise=true , address=45.91.116.4:4962     , piece_id=LZDUUTUUN4SZZDCPPDDT4LBFO7IH3WHQNXVY2TSK7Z5543ELZPEA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.454995842 (128h1m22.282704239s) [noise=true , address=45.91.116.10:4087    , piece_id=4VPKXU7NHUC25NWJHJ4TVSMNRADPVGJC4AGVUDUBEXARZIJCB5UA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.455561273 (128h1m22.28326967s) [noise=true , address=145.79.227.15:4887   , piece_id=D5KQQB6K746ONSSPG2AYAG7Z2LTTDB5SCUIZN4DGJ3WM2XCNWQ3Q, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.455762939 (128h1m22.283471334s) [noise=true , address=145.79.227.21:4476   , piece_id=XJWHM43B7XEEDLM4GLILTJ3EO7FLIYU7NMXAL53FE47Z2D3VYRRA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.456558891 (128h1m22.284267283s) [noise=true , address=45.91.116.11:4126    , piece_id=Z5VTXSRK5YYI5UK3GSN62ABAEAATSUZEFWLASM4QAKQCYKIVQVQQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.464406476 (128h1m22.292114868s) [noise=true , address=145.79.227.26:4674   , piece_id=3253RHRC2DXRDATZ5D2RBTSQMI3ZUBH6L4HMFWK62WC7HJXEMTDA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.473112023 (128h1m22.300820413s) [noise=true , address=45.91.116.11:4141    , piece_id=2X4A55TZ3XEDYIBDZNUMPT7UYKNH4LCNPK77M37SSUSYJFKOC3HQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.473609731 (128h1m22.301318129s) [noise=true , address=145.79.227.28:4755   , piece_id=3LAPEHXG2LTIDBMIQ6UYWIBFKEPKJSGYFDFXO57AVM7JAOZHFPVQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.476565614 (128h1m22.30427401s) [noise=true , address=45.91.116.5:4305     , piece_id=XFSYEUTFVJF7FWKNYPK2IX2ELLD4N3XIPKB226YLD4DZ5DLTCXOQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:21.479313327 (128h1m22.307021721s) [noise=true , address=145.79.227.2:4137    , piece_id=GYM6LUNOI2YNEF4MA2GNV6ORSEXAKPYESBJF5VNOXOKH7WGE4YLA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:29:22.605851230 (128h1m23.433559623s) [noise=true , address=145.79.227.44:4200   , piece_id=3NFBD7AG3BILIKYPJ55UFD75MDD2EOKSLRZGVP5X4F4CPDVZSBKQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: <nil>
Dec 10 23:30:21.319245769 (128h2m22.146954166s) [noise=true , address=77.90.31.13:4642     , piece_id=AZ5ZTA3LP3MAUNCRYI2DW5RBJALL3GARN2MH3NCP5DYTLDTYJDIQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:1xdfVQUEMLaGgw7hsBtHZVTKL9BTTxPeYve53efw8GPdSQDL9D, address:77.90.31.13:4642): protocol: write tcp 159.223.143.39:34630->77.90.31.13:4642: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.319416400 (128h2m22.147124797s) [noise=true , address=77.90.31.17:4790     , piece_id=IPVMHL4COMOCX2QMOV22J4SATAZQ73E27WW73KCZQSO6BO7ATAAQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:1vDiVaJCoCnC6GqF5ZjhVwA6QCo1HkvRDYqLhEfKM8z91bv25b, address:77.90.31.17:4790): protocol: write tcp 159.223.143.39:38620->77.90.31.17:4790: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.319428872 (128h2m22.147137266s) [noise=true , address=77.90.31.16:4736     , piece_id=ECKNYKLH7KMOF6DDDXY3DGA6DCIQVGFH453ANA4TEWBITC53CEBA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: write tcp 159.223.143.39:38308->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.319579167 (128h2m22.147287564s) [noise=true , address=77.90.31.21:4909     , piece_id=NSRO6F674XMDA42UELXTH3VRGIPM4ZX5ACJYRRTYVIEGHBFQABTQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6, address:77.90.31.21:4909): protocol: write tcp 159.223.143.39:57154->77.90.31.21:4909: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.319639235 (128h2m22.147347633s) [noise=true , address=77.90.31.12:4610     , piece_id=7VW2BQWODDIUL3HZD6F3AMOZ7XKOCOGZKFAPOTS7J5ZHLDJ5A3TQ, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:12aJUUvWNCYSbhTkNgjAj6FPXK5LK2qdHDqntvrVabGwD2BhsYi, address:77.90.31.12:4610): protocol: write tcp 159.223.143.39:54152->77.90.31.12:4610: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:21.320713981 (128h2m22.148422373s) [noise=true , address=77.90.31.19:4869     , piece_id=625UNSZHDY2DG3MOO27DDY53QJFWVNYDIAEZ4FT4GLIY3VHVVCKA, seg_pos={0 0}, upload=133132]: Done uploading piece. err: ecclient: upload failed (node:129refeNg3BsDCThccHdMUJgitGM942qREieZCP2UYoicRAtFN8, address:77.90.31.19:4869): protocol: write tcp 159.223.143.39:36304->77.90.31.19:4869: use of closed network connection; context deadline exceeded
Dec 10 23:30:21.320782840 (128h2m22.148491235s) [seg_pos={0 0}, upload=133132]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Dec 10 23:30:21.341189888 (128h2m22.168898283s) [upload=133132]: Done uploading segments...
Dec 10 23:30:21.341230070 (128h2m22.168938462s) [upload=133132]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1m0.024877993s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [..................................................XXX.X.....]
duration: 
502.403198ms
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:30:18 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 502.433637ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
6 out of 60 is failed (threshold=3) [....................................................XX..XXXX]
duration: 
1m0.036941896s
trace: 
https://jaeger.dev.storj.io/trace/5e5038367fc09ba9
FAIL (2025-12-10 23:30:13 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
Dec 10 23:29:13.414006536 (128h1m14.241714935s) [upload=133131]: Starting upload
Dec 10 23:29:13.414082045 (128h1m14.241790439s) [upload=133131]: Done starting upload
Dec 10 23:29:13.414177426 (128h1m14.241885809s) [upload=133131]: Uploading segments...
Dec 10 23:29:13.414564648 (128h1m14.242273046s) [upload=133131]: Got next segment. Inline: false
Dec 10 23:29:13.414619899 (128h1m14.242328282s) [upload=133131]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:29:13.414639733 (128h1m14.242348131s) [upload=133131]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:29:13.448333114 (128h1m14.276041495s) [seg_pos={0 0}, upload=133131]: Begin upload segment...
Dec 10 23:29:13.448393360 (128h1m14.276101752s) [seg_pos={0 0}, upload=133131]: Done begin upload segment.
Dec 10 23:29:13.448422689 (128h1m14.27613108s) [noise=true , address=145.79.227.30:4792   , piece_id=FCFD4P35EEPQD2MF42RHNXCVJNMWWPAJZHKPQOXQBBQCF3F5Y35Q, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.449438545 (128h1m14.277146945s) [noise=true , address=145.79.227.52:4462   , piece_id=7WR2V7KERIQF6XNRSOD74U6MMWDDU5FMOBBG6UJUOY67PGY2FAUQ, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.450060485 (128h1m14.277768876s) [noise=true , address=5.231.73.4:4007      , piece_id=3C4COSC5GSZOTEFRBIGYVUVS3YGXI63465D4E2XYUZHADUMOK6TQ, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.450280981 (128h1m14.277989373s) [noise=true , address=77.90.31.19:4853     , piece_id=2N6LPBIGPSBMKXYX4QBDBHDTMB7HST4AUVELM3CGU6NJUTENVIJA, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.450541946 (128h1m14.278250346s) [noise=true , address=145.79.227.11:4734   , piece_id=A3JG4OMVUHENWVHK3FIZI2YVVUUZLRJGKBQH5OKAP4H4BENFJFTA, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.450710074 (128h1m14.278418468s) [noise=true , address=77.90.31.21:4882     , piece_id=3XEANOZNGHZBXLZ6CQEJHQCP5EPOE63AQJ6GMD7CGHCUVKDVYKDA, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.451066610 (128h1m14.278775007s) [noise=true , address=145.79.227.24:4588   , piece_id=MSM7U7BKIIE7ISPH5DG7YJKRL2BARKLROJQPINEFMAIJ6LQJE5MQ, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.451162029 (128h1m14.278870426s) [noise=true , address=145.79.227.47:4298   , piece_id=L3XHP6AHBAQC26Q6G6S6VRYAO3V6YMA7TUF3TEAUCUTGTA5HI3IA, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.451557780 (128h1m14.279266174s) [noise=true , address=45.91.116.4:4946     , piece_id=HIRIFD7GVDPEZJSFOT6DD5X2RKOQ2T2IZFMTX6WRINXG5U4VHJOQ, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.451611265 (128h1m14.279319661s) [noise=true , address=77.90.31.13:4650     , piece_id=YCKXRPTIQ52RTI75AMOOJACYVHOVPMHXCBYJU2MOZ7N242URVOIA, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.452088542 (128h1m14.279796942s) [noise=true , address=77.90.31.17:4787     , piece_id=R42II4ILHM5CGUPISDYWWNBOFLZ6HFVJ74YH52U4LASJIREOEZLQ, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.452119509 (128h1m14.279827904s) [noise=true , address=145.79.227.4:4194    , piece_id=TJWBQ5RNL37EBDE5AUME4EWJU6M64MEN72WDWS4WN4VAU6FS3N3A, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.453140914 (128h1m14.280849311s) [noise=true , address=64.49.13.27:4963     , piece_id=VMFXMY23AFFB42URZUL7CH6OGDBTT2BLU2LAIN4JW4L4CFKJUTAQ, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.454132863 (128h1m14.281841257s) [noise=true , address=77.90.31.16:4762     , piece_id=IOF6MEDYKMEKAF7JWNGPRXQAAWY63IMNQPSBRYJ474A3SJD23GHA, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.455541749 (128h1m14.28325015s) [noise=true , address=45.91.116.8:4049     , piece_id=V2AM7VOIP3Y344TVCXQ5T7OFTZSKH7BURH4JDBQBULD4K2FBM3FA, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.456954703 (128h1m14.284663103s) [noise=true , address=45.91.116.9:4271     , piece_id=KKYYQGSY7243RE2NRSYS57TUENEH5IKYMCZXNUEJCYAS4HR2BISQ, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.458150829 (128h1m14.285859226s) [noise=true , address=64.49.13.26:4955     , piece_id=TK2XLOCR5ECWK52RHQ67W4QRLNDVQTA3IQPTEX2C4YMVUPK5JE7Q, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.460791785 (128h1m14.288500186s) [noise=true , address=45.91.116.6:4987     , piece_id=IVQ26P4U74QKOUSTWVL63DVZK5HYLBWE7WFUY5A6ZLU643SQKFRQ, seg_pos={0 0}, upload=133131]: Uploading piece...
Dec 10 23:29:13.521437654 (128h1m14.349146052s) [upload=133131]: Next returned nil segment
Dec 10 23:29:13.521464449 (128h1m14.349172865s) [upload=133131]: Waiting for error group managing segments...
Dec 10 23:29:13.524691536 (128h1m14.352399927s) [noise=true , address=45.91.116.8:4049     , piece_id=V2AM7VOIP3Y344TVCXQ5T7OFTZSKH7BURH4JDBQBULD4K2FBM3FA, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:13.525908292 (128h1m14.353616685s) [noise=true , address=45.91.116.4:4946     , piece_id=HIRIFD7GVDPEZJSFOT6DD5X2RKOQ2T2IZFMTX6WRINXG5U4VHJOQ, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:13.527985536 (128h1m14.355693944s) [noise=true , address=145.79.227.24:4588   , piece_id=MSM7U7BKIIE7ISPH5DG7YJKRL2BARKLROJQPINEFMAIJ6LQJE5MQ, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:13.529298068 (128h1m14.357006464s) [noise=true , address=145.79.227.4:4194    , piece_id=TJWBQ5RNL37EBDE5AUME4EWJU6M64MEN72WDWS4WN4VAU6FS3N3A, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:13.529667341 (128h1m14.357375733s) [noise=true , address=145.79.227.11:4734   , piece_id=A3JG4OMVUHENWVHK3FIZI2YVVUUZLRJGKBQH5OKAP4H4BENFJFTA, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:13.530883907 (128h1m14.35859229s) [noise=true , address=45.91.116.6:4987     , piece_id=IVQ26P4U74QKOUSTWVL63DVZK5HYLBWE7WFUY5A6ZLU643SQKFRQ, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:13.546821435 (128h1m14.374529826s) [noise=true , address=145.79.227.47:4298   , piece_id=L3XHP6AHBAQC26Q6G6S6VRYAO3V6YMA7TUF3TEAUCUTGTA5HI3IA, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:13.558916208 (128h1m14.386624599s) [noise=true , address=45.91.116.9:4271     , piece_id=KKYYQGSY7243RE2NRSYS57TUENEH5IKYMCZXNUEJCYAS4HR2BISQ, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:13.563327960 (128h1m14.39103636s) [noise=true , address=145.79.227.52:4462   , piece_id=7WR2V7KERIQF6XNRSOD74U6MMWDDU5FMOBBG6UJUOY67PGY2FAUQ, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:13.626572178 (128h1m14.454280569s) [noise=true , address=5.231.73.4:4007      , piece_id=3C4COSC5GSZOTEFRBIGYVUVS3YGXI63465D4E2XYUZHADUMOK6TQ, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:14.053132003 (128h1m14.880840394s) [noise=true , address=64.49.13.26:4955     , piece_id=TK2XLOCR5ECWK52RHQ67W4QRLNDVQTA3IQPTEX2C4YMVUPK5JE7Q, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:14.095649524 (128h1m14.923357915s) [noise=true , address=64.49.13.27:4963     , piece_id=VMFXMY23AFFB42URZUL7CH6OGDBTT2BLU2LAIN4JW4L4CFKJUTAQ, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:29:14.575009065 (128h1m15.40271746s) [noise=true , address=145.79.227.30:4792   , piece_id=FCFD4P35EEPQD2MF42RHNXCVJNMWWPAJZHKPQOXQBBQCF3F5Y35Q, seg_pos={0 0}, upload=133131]: Done uploading piece. err: <nil>
Dec 10 23:30:13.382493055 (128h2m14.210201453s) [noise=true , address=77.90.31.19:4853     , piece_id=2N6LPBIGPSBMKXYX4QBDBHDTMB7HST4AUVELM3CGU6NJUTENVIJA, seg_pos={0 0}, upload=133131]: Done uploading piece. err: ecclient: upload failed (node:1WBuBdGxdPXi6VsNf4FJpn3LpWoQztM7CV6YjAW1mUDVjAUjn2, address:77.90.31.19:4853): protocol: write tcp 159.223.143.39:40334->77.90.31.19:4853: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:13.382953783 (128h2m14.210662176s) [noise=true , address=77.90.31.21:4882     , piece_id=3XEANOZNGHZBXLZ6CQEJHQCP5EPOE63AQJ6GMD7CGHCUVKDVYKDA, seg_pos={0 0}, upload=133131]: Done uploading piece. err: ecclient: upload failed (node:1qmk23WxPsi88atKkdoQN3vJ3K1YDfNHYBMgYzcc52VURVA9V1, address:77.90.31.21:4882): protocol: rpc: dial tcp 77.90.31.21:4882: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:13.383435646 (128h2m14.211144043s) [noise=true , address=77.90.31.13:4650     , piece_id=YCKXRPTIQ52RTI75AMOOJACYVHOVPMHXCBYJU2MOZ7N242URVOIA, seg_pos={0 0}, upload=133131]: Done uploading piece. err: ecclient: upload failed (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU, address:77.90.31.13:4650): protocol: rpc: dial tcp 77.90.31.13:4650: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:13.383679184 (128h2m14.211387584s) [noise=true , address=77.90.31.17:4787     , piece_id=R42II4ILHM5CGUPISDYWWNBOFLZ6HFVJ74YH52U4LASJIREOEZLQ, seg_pos={0 0}, upload=133131]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: context deadline exceeded; context deadline exceeded
Dec 10 23:30:13.383799269 (128h2m14.211507662s) [noise=true , address=77.90.31.16:4762     , piece_id=IOF6MEDYKMEKAF7JWNGPRXQAAWY63IMNQPSBRYJ474A3SJD23GHA, seg_pos={0 0}, upload=133131]: Done uploading piece. err: ecclient: upload failed (node:1SdEfJoiiNeVAJ6QkDdqZRuuqgsWvB7LAvNc69HUapL8r8qscR, address:77.90.31.16:4762): protocol: write tcp 159.223.143.39:36092->77.90.31.16:4762: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:30:13.383831494 (128h2m14.211539877s) [seg_pos={0 0}, upload=133131]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Dec 10 23:30:13.416654746 (128h2m14.244363144s) [upload=133131]: Done uploading segments...
Dec 10 23:30:13.416700510 (128h2m14.244408911s) [upload=133131]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.036960147s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [...................................................X....X...]
duration: 
485.272813ms
trace: 
https://jaeger.dev.storj.io/trace/40c8a6c09ccb5923
FAIL (2025-12-10 23:29:48 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 485.298959ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [...................................................XXX......]
duration: 
587.088128ms
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:29:45 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 587.113796ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
6 out of 60 is failed (threshold=3) [......................................................XXXXXX]
duration: 
1m0.031754948s
trace: 
https://jaeger.dev.storj.io/trace/66f9448bd2d01545
FAIL (2025-12-10 23:29:21 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
ploading segments...
Dec 10 23:28:21.252410918 (128h0m22.080119299s) [upload=133116]: Got next segment. Inline: false
Dec 10 23:28:21.252449078 (128h0m22.08015747s) [upload=133116]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:28:21.252454522 (128h0m22.080162905s) [upload=133116]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:28:21.280294893 (128h0m22.108003287s) [seg_pos={0 0}, upload=133116]: Begin upload segment...
Dec 10 23:28:21.280357678 (128h0m22.108066073s) [seg_pos={0 0}, upload=133116]: Done begin upload segment.
Dec 10 23:28:21.280407689 (128h0m22.108116091s) [noise=true , address=145.79.227.36:4545   , piece_id=7F5RUIRV6DAQZYZGRCTKAXFAIJUN5QYNPLZEZGNFGXGU4ZQEZ4GA, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.280424483 (128h0m22.108132879s) [noise=true , address=145.79.227.40:4064   , piece_id=5XXYKGTOHYE4KKJAANXOI6RSEUAPADQRGEDMPT5S4XVVBTB7PPIQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.281057220 (128h0m22.108765615s) [noise=true , address=45.91.116.13:4173    , piece_id=UBQ2PHVHVQVG4K7GEAWDTTIU2NKODGNB2RMOBG4T5AODA2ACK6RQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.281183916 (128h0m22.108892297s) [noise=true , address=145.79.227.33:4881   , piece_id=P7YUZPUFZUFRJXTOJOYUYACP5UPCCE2OWPFJ4X3RV6WLBVI6K5IQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.281681579 (128h0m22.10938997s) [noise=true , address=77.90.31.12:4612     , piece_id=W525IQYQHS5E7CQLA54B5RLGTJHFQCTDUVD3D7SDLYUNCTOWFM4A, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.282215721 (128h0m22.109924115s) [noise=true , address=77.90.31.18:4815     , piece_id=H6ZZAW4SF6LR3QZBLXH36OEUXHTYD3ODTHHYA2TBGR4B22XXI5LA, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.282814980 (128h0m22.110523361s) [noise=true , address=145.79.227.52:4466   , piece_id=IJTIPWGIICSTV7YK4QK3GHVO4SBX26ICHTWKOEGNBER6KDKHZHUA, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.283151542 (128h0m22.110859924s) [noise=true , address=145.79.227.29:4973   , piece_id=WKLNLHJQ7YFXUGHR3QPKSUJUKPARMBK7524N6XNFZGMQ7QKCL7NQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.283690665 (128h0m22.111399059s) [noise=true , address=5.231.73.5:4022      , piece_id=QJNI23NW5LBXK44FTAO7WC2YSPZURLZWQSGWJO2BRRCWH47OTNFA, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.283930494 (128h0m22.111638888s) [noise=true , address=45.91.116.10:4093    , piece_id=JYA4EN4E7F6YBEB4LHGJ6E77D3DH6ECFTLDAZZL7JJEBMDIIEYIQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.284603550 (128h0m22.112311932s) [noise=true , address=45.91.116.14:4199    , piece_id=64RC5A6ZG226JCN732ORFWAUCOBQHSQZKHSXJI6VHIV5ALZJXFUQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.284714342 (128h0m22.112422734s) [noise=true , address=45.91.116.12:4230    , piece_id=AOQHBZOEV4VASSJUNQXCVTBXB5M7TLTAZNCJNIMF7WEBED7RYFRA, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.285310574 (128h0m22.113018955s) [noise=true , address=77.90.31.11:4570     , piece_id=BAXCWGJD47O32F3XTJ7NWRKOYEYQLFHIZOONUTMXXFF3XPYZKCUQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.285432448 (128h0m22.113140829s) [noise=true , address=77.90.31.13:4651     , piece_id=LGTCJ3ATK32E3TBIMFETHDQN5TFHEK5HJ4DNZ4H2UTSCCNQKZHZQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.285886702 (128h0m22.113595096s) [noise=true , address=77.90.31.21:4904     , piece_id=UAKKGHCLHPKZWQKYO4IYJ62UBGORPM6P4SNDBYRXAUO6WFY7G5VQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.286185903 (128h0m22.113894301s) [noise=true , address=64.49.13.169:4708    , piece_id=MPEPGS6DO76EDCKZGVNRFDFF2WSRWJKJU5JRAEJOLQIWJKN6F2SQ, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.287058076 (128h0m22.114766457s) [noise=true , address=145.79.227.15:4879   , piece_id=WRVEAD6TUPFQPQVSBYAUDTCXGATMPE675MO62H5OHG5XARSIN36Q, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.287398597 (128h0m22.115106979s) [noise=true , address=45.91.116.6:4982     , piece_id=54KT2XIIW4VESE72ESDU3TTPYSMU7NGMPISTZ2BIZUDCOJLAX66Q, seg_pos={0 0}, upload=133116]: Uploading piece...
Dec 10 23:28:21.364047100 (128h0m22.1917555s) [upload=133116]: Next returned nil segment
Dec 10 23:28:21.364064946 (128h0m22.191773347s) [upload=133116]: Waiting for error group managing segments...
Dec 10 23:28:21.366612231 (128h0m22.194320632s) [noise=true , address=45.91.116.6:4982     , piece_id=54KT2XIIW4VESE72ESDU3TTPYSMU7NGMPISTZ2BIZUDCOJLAX66Q, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.366807229 (128h0m22.194515619s) [noise=true , address=45.91.116.13:4173    , piece_id=UBQ2PHVHVQVG4K7GEAWDTTIU2NKODGNB2RMOBG4T5AODA2ACK6RQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.367326621 (128h0m22.19503502s) [noise=true , address=45.91.116.14:4199    , piece_id=64RC5A6ZG226JCN732ORFWAUCOBQHSQZKHSXJI6VHIV5ALZJXFUQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.368656677 (128h0m22.196365058s) [noise=true , address=145.79.227.40:4064   , piece_id=5XXYKGTOHYE4KKJAANXOI6RSEUAPADQRGEDMPT5S4XVVBTB7PPIQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.370800295 (128h0m22.198508676s) [noise=true , address=145.79.227.33:4881   , piece_id=P7YUZPUFZUFRJXTOJOYUYACP5UPCCE2OWPFJ4X3RV6WLBVI6K5IQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.380510249 (128h0m22.208218641s) [noise=true , address=145.79.227.52:4466   , piece_id=IJTIPWGIICSTV7YK4QK3GHVO4SBX26ICHTWKOEGNBER6KDKHZHUA, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.381825233 (128h0m22.209533612s) [noise=true , address=45.91.116.10:4093    , piece_id=JYA4EN4E7F6YBEB4LHGJ6E77D3DH6ECFTLDAZZL7JJEBMDIIEYIQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.385052486 (128h0m22.212760887s) [noise=true , address=145.79.227.29:4973   , piece_id=WKLNLHJQ7YFXUGHR3QPKSUJUKPARMBK7524N6XNFZGMQ7QKCL7NQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.385633454 (128h0m22.213341835s) [noise=true , address=145.79.227.36:4545   , piece_id=7F5RUIRV6DAQZYZGRCTKAXFAIJUN5QYNPLZEZGNFGXGU4ZQEZ4GA, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.389431509 (128h0m22.217139889s) [noise=true , address=45.91.116.12:4230    , piece_id=AOQHBZOEV4VASSJUNQXCVTBXB5M7TLTAZNCJNIMF7WEBED7RYFRA, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.413533637 (128h0m22.241242019s) [noise=true , address=145.79.227.15:4879   , piece_id=WRVEAD6TUPFQPQVSBYAUDTCXGATMPE675MO62H5OHG5XARSIN36Q, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:21.507088522 (128h0m22.334796914s) [noise=true , address=5.231.73.5:4022      , piece_id=QJNI23NW5LBXK44FTAO7WC2YSPZURLZWQSGWJO2BRRCWH47OTNFA, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:28:27.328878751 (128h0m28.156587146s) [noise=true , address=64.49.13.169:4708    , piece_id=MPEPGS6DO76EDCKZGVNRFDFF2WSRWJKJU5JRAEJOLQIWJKN6F2SQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: <nil>
Dec 10 23:29:21.219311182 (128h1m22.047019584s) [noise=true , address=77.90.31.11:4570     , piece_id=BAXCWGJD47O32F3XTJ7NWRKOYEYQLFHIZOONUTMXXFF3XPYZKCUQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: ecclient: upload failed (node:12NFW5tt5R84RaTvY9Up75kNjZ7bmLAgUun41KLdW9Q7eMv27Sq, address:77.90.31.11:4570): protocol: write tcp 159.223.143.39:59028->77.90.31.11:4570: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:21.219331564 (128h1m22.04703996s) [noise=true , address=77.90.31.18:4815     , piece_id=H6ZZAW4SF6LR3QZBLXH36OEUXHTYD3ODTHHYA2TBGR4B22XXI5LA, seg_pos={0 0}, upload=133116]: Done uploading piece. err: ecclient: upload failed (node:12wBqmJYPpcmfnt1zWABq5JyjU66NkLetiDvLMAaNTE1zh5bJgw, address:77.90.31.18:4815): protocol: rpc: dial tcp 77.90.31.18:4815: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:21.219648828 (128h1m22.047357224s) [noise=true , address=77.90.31.12:4612     , piece_id=W525IQYQHS5E7CQLA54B5RLGTJHFQCTDUVD3D7SDLYUNCTOWFM4A, seg_pos={0 0}, upload=133116]: Done uploading piece. err: ecclient: upload failed (node:12nnXd911ApLeiKnc4LgDEUNnnkxtnLEdwzP48BhuhyEykacV6W, address:77.90.31.12:4612): protocol: rpc: dial tcp 77.90.31.12:4612: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:21.219913305 (128h1m22.047621705s) [noise=true , address=77.90.31.13:4651     , piece_id=LGTCJ3ATK32E3TBIMFETHDQN5TFHEK5HJ4DNZ4H2UTSCCNQKZHZQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: ecclient: upload failed (node:12KZPTKQVuPNRTddMCCVpEgu9z5aC3ooJC854HpuA9223XEQA1o, address:77.90.31.13:4651): protocol: rpc: dial tcp 77.90.31.13:4651: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:21.220055970 (128h1m22.047764361s) [noise=true , address=77.90.31.21:4904     , piece_id=UAKKGHCLHPKZWQKYO4IYJ62UBGORPM6P4SNDBYRXAUO6WFY7G5VQ, seg_pos={0 0}, upload=133116]: Done uploading piece. err: ecclient: upload failed (node:12eUC555Lzo37B5FafAFMfXjSkfm1zv1pRZmH71jf4xpdCWH6kG, address:77.90.31.21:4904): protocol: write tcp 159.223.143.39:46348->77.90.31.21:4904: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:21.220085803 (128h1m22.047794194s) [seg_pos={0 0}, upload=133116]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Dec 10 23:29:21.248383233 (128h1m22.076091627s) [upload=133116]: Done uploading segments...
Dec 10 23:29:21.248417195 (128h1m22.076125588s) [upload=133116]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.031766794s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [....................................................X....X..]
duration: 
469.552605ms
trace: 
https://jaeger.dev.storj.io/trace/40c8a6c09ccb5923
FAIL (2025-12-10 23:29:16 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 469.577267ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [.....................................................XX..XXX]
duration: 
1m0.032313713s
trace: 
https://jaeger.dev.storj.io/trace/2c5155bcb523cdbf
FAIL (2025-12-10 23:29:13 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 10)
======LOGS======
Dec 10 23:28:13.327910098 (128h0m14.1556185s) [upload=133112]: Starting upload
Dec 10 23:28:13.328077874 (128h0m14.155786272s) [upload=133112]: Done starting upload
Dec 10 23:28:13.328153430 (128h0m14.155861823s) [upload=133112]: Uploading segments...
Dec 10 23:28:13.328708699 (128h0m14.156417078s) [upload=133112]: Got next segment. Inline: false
Dec 10 23:28:13.328800124 (128h0m14.156508515s) [upload=133112]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:28:13.328805748 (128h0m14.156514139s) [upload=133112]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:28:13.356366330 (128h0m14.184074727s) [seg_pos={0 0}, upload=133112]: Begin upload segment...
Dec 10 23:28:13.356413508 (128h0m14.1841219s) [seg_pos={0 0}, upload=133112]: Done begin upload segment.
Dec 10 23:28:13.356449953 (128h0m14.184158344s) [noise=true , address=145.79.227.34:4929   , piece_id=L4W3UEC5FJPXH6QTSRXM4IHRR5XYRN6MAV67ZVOKR6XQS7SCPTOQ, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.356534616 (128h0m14.184243011s) [noise=true , address=145.79.227.16:4936   , piece_id=XSCGV4WPFDLBIH23P6L3MEJYXDGAIKCWDMWTCK4KXUPIBNLXFPNA, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.357094598 (128h0m14.184803s) [noise=true , address=77.90.31.13:4647     , piece_id=ISSKJE6Z3W2L4UL7BXTU4FFQHGJXMQ67SGOCH66ZQJMLQPEXYY4A, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.357419815 (128h0m14.185128208s) [noise=true , address=45.91.116.8:4073     , piece_id=65J7UG3C23SOJL6L33QPNKN5CPCTNGFAEEHCOYGKAOD6ECOJYNRQ, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.357839006 (128h0m14.185547397s) [noise=true , address=145.79.227.31:4804   , piece_id=YU3EXDHDXKW4K7PGXCK2MXFYVCM3IM5JSZUCGZ3WBA6ZZIF7RAPA, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.358189205 (128h0m14.185897588s) [noise=true , address=145.79.227.45:4250   , piece_id=IXEVGU57GG6WAARDHKP7KAA5BPXMN72PH4SHUGJBR4INNGGFEZRA, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.358516306 (128h0m14.186224698s) [noise=true , address=77.90.31.17:4796     , piece_id=676AYRQJVHCUCIHET7QCOOE4TRIW5LERLK2VBPT4VMEUFO3E6V7Q, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.358874887 (128h0m14.186583269s) [noise=true , address=145.79.227.48:4328   , piece_id=CFMHVAYPKTD7GJY32CYKIZW7XUZLWD6HQTHA6ITNHIFSNYRSMXPQ, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.359269478 (128h0m14.186977877s) [noise=true , address=45.91.116.7:4012     , piece_id=MNEGWUERLBK52CTYHKRFB2FSTOQRXMVQP2CZFJNI6TLZ4XXQVWQQ, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.359343285 (128h0m14.18705168s) [noise=true , address=45.91.116.13:4175    , piece_id=YV2EG6BIY5SCNFV2D7MQDS3WKDOETAGRPAF32NVIKA7S3DSJSAVQ, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.359663870 (128h0m14.187372264s) [noise=true , address=77.90.31.16:4741     , piece_id=RHEC6ESNDS2B4YU6S2WM73UQ626IBISEEONES6P5DPOP45WLOCXQ, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.359723929 (128h0m14.187432311s) [noise=true , address=45.91.116.4:4962     , piece_id=GPJC5IJWGKKW63LKWC4SGCZNDERM2H24E3JKRN5GI57UTUDNIZ4A, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.360020502 (128h0m14.187728898s) [noise=true , address=77.90.31.12:4611     , piece_id=WRFZNQRWLREPK63JTRNDZS7C3IBPC3HGW5EUWDPIHBSXQL4PH2EA, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.360078859 (128h0m14.187787241s) [noise=true , address=77.90.31.17:4790     , piece_id=IN64DP3VGRTR76CTWMBH3WIJKY6MXKQ7SEWGPWU7CFYBKDN7AS6Q, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.360536799 (128h0m14.1882452s) [noise=true , address=77.90.31.19:4847     , piece_id=4LPABKNCPHLPUBTYCQ5VYQU2M2OTUERFE6YM5QAF467AYOGHFJIA, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.360985205 (128h0m14.188693586s) [noise=true , address=77.90.31.15:4717     , piece_id=6U2QZPFPRMO5GFR67TB5RCIWHYPKTK5LCYO5SS2PUA2DXGMJI3FQ, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.361358741 (128h0m14.189067135s) [noise=true , address=145.79.227.18:4015   , piece_id=XEJK5ZFEYZYUDGPK62DPNXLVDFUTU6L6AGPZW5SHRY7K4MX4LKYA, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.361640009 (128h0m14.189348387s) [noise=true , address=77.90.31.18:4808     , piece_id=RNXK3GCU55GPTQZDBLQ3UBOOXKPVWUJCEJHNX3JZ6UBISEV7FJPQ, seg_pos={0 0}, upload=133112]: Uploading piece...
Dec 10 23:28:13.428116176 (128h0m14.255824567s) [upload=133112]: Next returned nil segment
Dec 10 23:28:13.428130811 (128h0m14.255839202s) [upload=133112]: Waiting for error group managing segments...
Dec 10 23:28:13.434293563 (128h0m14.26200196s) [noise=true , address=45.91.116.4:4962     , piece_id=GPJC5IJWGKKW63LKWC4SGCZNDERM2H24E3JKRN5GI57UTUDNIZ4A, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:28:13.434863910 (128h0m14.262572302s) [noise=true , address=145.79.227.48:4328   , piece_id=CFMHVAYPKTD7GJY32CYKIZW7XUZLWD6HQTHA6ITNHIFSNYRSMXPQ, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:28:13.435130602 (128h0m14.262838993s) [noise=true , address=145.79.227.18:4015   , piece_id=XEJK5ZFEYZYUDGPK62DPNXLVDFUTU6L6AGPZW5SHRY7K4MX4LKYA, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:28:13.435591700 (128h0m14.263300095s) [noise=true , address=145.79.227.45:4250   , piece_id=IXEVGU57GG6WAARDHKP7KAA5BPXMN72PH4SHUGJBR4INNGGFEZRA, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:28:13.438277558 (128h0m14.26598595s) [noise=true , address=145.79.227.34:4929   , piece_id=L4W3UEC5FJPXH6QTSRXM4IHRR5XYRN6MAV67ZVOKR6XQS7SCPTOQ, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:28:13.445593417 (128h0m14.273301812s) [noise=true , address=45.91.116.13:4175    , piece_id=YV2EG6BIY5SCNFV2D7MQDS3WKDOETAGRPAF32NVIKA7S3DSJSAVQ, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:28:13.447557085 (128h0m14.275265475s) [noise=true , address=45.91.116.7:4012     , piece_id=MNEGWUERLBK52CTYHKRFB2FSTOQRXMVQP2CZFJNI6TLZ4XXQVWQQ, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:28:13.450737193 (128h0m14.278445584s) [noise=true , address=45.91.116.8:4073     , piece_id=65J7UG3C23SOJL6L33QPNKN5CPCTNGFAEEHCOYGKAOD6ECOJYNRQ, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:28:13.455191199 (128h0m14.282899593s) [noise=true , address=145.79.227.31:4804   , piece_id=YU3EXDHDXKW4K7PGXCK2MXFYVCM3IM5JSZUCGZ3WBA6ZZIF7RAPA, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:28:14.411444226 (128h0m15.239152617s) [noise=true , address=145.79.227.16:4936   , piece_id=XSCGV4WPFDLBIH23P6L3MEJYXDGAIKCWDMWTCK4KXUPIBNLXFPNA, seg_pos={0 0}, upload=133112]: Done uploading piece. err: <nil>
Dec 10 23:29:13.295493315 (128h1m14.123201709s) [noise=true , address=77.90.31.17:4796     , piece_id=676AYRQJVHCUCIHET7QCOOE4TRIW5LERLK2VBPT4VMEUFO3E6V7Q, seg_pos={0 0}, upload=133112]: Done uploading piece. err: ecclient: upload failed (node:1KK6y5NBuZovne8n3gMvAyDcZFasZxDzorvPeHe7CefoFs27UF, address:77.90.31.17:4796): protocol: write tcp 159.223.143.39:36748->77.90.31.17:4796: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:13.295750557 (128h1m14.123458958s) [noise=true , address=77.90.31.17:4790     , piece_id=IN64DP3VGRTR76CTWMBH3WIJKY6MXKQ7SEWGPWU7CFYBKDN7AS6Q, seg_pos={0 0}, upload=133112]: Done uploading piece. err: ecclient: upload failed (node:1vDiVaJCoCnC6GqF5ZjhVwA6QCo1HkvRDYqLhEfKM8z91bv25b, address:77.90.31.17:4790): protocol: rpc: dial tcp 77.90.31.17:4790: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:13.296021982 (128h1m14.123730419s) [noise=true , address=77.90.31.13:4647     , piece_id=ISSKJE6Z3W2L4UL7BXTU4FFQHGJXMQ67SGOCH66ZQJMLQPEXYY4A, seg_pos={0 0}, upload=133112]: Done uploading piece. err: ecclient: upload failed (node:121XgCUbGhKnfnTDNasmpgsQzzkZAqnFie53A7pB793wKT9VCZv, address:77.90.31.13:4647): protocol: rpc: dial tcp 77.90.31.13:4647: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:13.296085272 (128h1m14.12379367s) [noise=true , address=77.90.31.19:4847     , piece_id=4LPABKNCPHLPUBTYCQ5VYQU2M2OTUERFE6YM5QAF467AYOGHFJIA, seg_pos={0 0}, upload=133112]: Done uploading piece. err: ecclient: upload failed (node:12RkRJoWfBB5tUsZScQgydJhY5XffVuQn1JUa1ZHThjcP3bUfJv, address:77.90.31.19:4847): protocol: rpc: dial tcp 77.90.31.19:4847: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:13.296233655 (128h1m14.123942046s) [noise=true , address=77.90.31.18:4808     , piece_id=RNXK3GCU55GPTQZDBLQ3UBOOXKPVWUJCEJHNX3JZ6UBISEV7FJPQ, seg_pos={0 0}, upload=133112]: Done uploading piece. err: ecclient: upload failed (node:1bAoTamwp534btqQDaG1TdCMJghkj8ZqTQtqJub1X3kp3VoJn9, address:77.90.31.18:4808): protocol: rpc: dial tcp 77.90.31.18:4808: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:13.296578326 (128h1m14.124286726s) [noise=true , address=77.90.31.16:4741     , piece_id=RHEC6ESNDS2B4YU6S2WM73UQ626IBISEEONES6P5DPOP45WLOCXQ, seg_pos={0 0}, upload=133112]: Done uploading piece. err: ecclient: upload failed (node:12G8MCviRyA85FwyuN3sXF9pwWQnP6mki6Ux68Eefx42BeWUcNR, address:77.90.31.16:4741): protocol: rpc: dial tcp 77.90.31.16:4741: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:13.296611110 (128h1m14.124319511s) [noise=true , address=77.90.31.12:4611     , piece_id=WRFZNQRWLREPK63JTRNDZS7C3IBPC3HGW5EUWDPIHBSXQL4PH2EA, seg_pos={0 0}, upload=133112]: Done uploading piece. err: ecclient: upload failed (node:1r7qdqiUuUqsKnTXdC3S1Ek84rsCPtjPoXbPugVHWBzJezv4W2, address:77.90.31.12:4611): protocol: rpc: dial tcp 77.90.31.12:4611: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:13.296883795 (128h1m14.124592197s) [noise=true , address=77.90.31.15:4717     , piece_id=6U2QZPFPRMO5GFR67TB5RCIWHYPKTK5LCYO5SS2PUA2DXGMJI3FQ, seg_pos={0 0}, upload=133112]: Done uploading piece. err: ecclient: upload failed (node:12ULANtxKNaJviAZFsmHjDQWjG4x2wfmjCwbQtHmn9LpnELmkPc, address:77.90.31.15:4717): protocol: rpc: dial tcp 77.90.31.15:4717: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:29:13.296916196 (128h1m14.12462459s) [seg_pos={0 0}, upload=133112]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil>
Dec 10 23:29:13.325143092 (128h1m14.152851489s) [upload=133112]: Done uploading segments...
Dec 10 23:29:13.325186785 (128h1m14.152895176s) [upload=133112]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10)
Duration: 1m0.03232761s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [...................................................XXX.X....]
duration: 
649.376836ms
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:29:08 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 649.414031ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [....................................................XXX.....]
duration: 
555.017102ms
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:28:39 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 555.04046ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [.....................................................X....X.]
duration: 
460.110574ms
trace: 
https://jaeger.dev.storj.io/trace/40c8a6c09ccb5923
FAIL (2025-12-10 23:28:33 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 460.135105ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
5 out of 60 is failed (threshold=3) [.......................................................XXXXX]
duration: 
1m0.025431264s
trace: 
https://jaeger.dev.storj.io/trace/64b8c94a97d3b4d8
FAIL (2025-12-10 23:28:21 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 10)
======LOGS======
2LEQYPDTOO2NZ5U6PPXTV2Q, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.199749820 (127h59m22.027458221s) [noise=true , address=64.49.13.169:4707    , piece_id=KST7M546EJOHVBKOSE3US2MYN6X6LWOWR2MX4DU6XLL3UMBKJFUQ, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.200330011 (127h59m22.028038402s) [noise=true , address=77.90.31.14:4675     , piece_id=KQQEKYEDDZXZ5IWVRZQDTW3I3FMSFLM66I2GQNYW5DT6FWQMO65A, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.200948925 (127h59m22.028657318s) [noise=true , address=145.79.227.23:4560   , piece_id=2CPE7D53EIOS5BRGGFYEWW4ECSEIHE2HRJX43QL5V5ZI6UMMBBSA, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.201039767 (127h59m22.028748158s) [noise=true , address=77.90.31.10:4538     , piece_id=DO3GTO4XBIQBRJ4QGZVVHWYL2AA5IS5S2ZEOEIEXES23CI72JDAQ, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.201085652 (127h59m22.028794047s) [noise=true , address=77.90.31.12:4622     , piece_id=AMJ72HBTQAIDCNG5ZTBJRUQSBIGX65D3FETT2ZSPL4WPLEJBEZDA, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.201153763 (127h59m22.028862154s) [noise=true , address=77.90.31.17:4797     , piece_id=NCP46UWVZIHBSEF2BGXEV7SFB7EZZPUSBBMJNYGIHHIDHVXTKSSQ, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.201205042 (127h59m22.028913439s) [noise=true , address=45.91.116.7:4013     , piece_id=ZO2SW73HZEWVVZK3VWPAK5KOGX2YPR5BIZAN6N6HWYAS2MHWXDIA, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.201256678 (127h59m22.028965069s) [noise=true , address=77.90.31.21:4882     , piece_id=P2RXPW2IX74KY6I2X4RVSJ4XNKV7MSWWTMZGUTYRT4XQPYNZCBLQ, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.201309268 (127h59m22.029017665s) [noise=true , address=145.79.227.27:4692   , piece_id=OMJDRWAWUO2DI62WMHNQRT3ZNS6CUO7JISAY6OIXSQWQHHCDKETA, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.201378722 (127h59m22.02908712s) [noise=true , address=45.91.116.12:4250    , piece_id=ZUD7CUHQMK64WECIKYLQKX2776YLKJMMFAQXXYM75FIPYZESUIIA, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.201440667 (127h59m22.02914906s) [noise=true , address=77.90.31.11:4556     , piece_id=ACCUGGXRZSI3F2DYCQG6YM4URCHRLRQXNYQXM3JAJQ7IZP6YDESQ, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.202525168 (127h59m22.030233562s) [noise=true , address=77.90.31.13:4659     , piece_id=GK6DU5LATBNKMLIT4RBYLVAK5WMDMBTJ2UVWCOAPPP7FPJ4EIN6A, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.204297146 (127h59m22.032005537s) [noise=true , address=45.91.116.9:4274     , piece_id=MWMFGSNEJTTPGJSSZTM3LWXQ5VTHVF3PTR3WZYDJUSXQVSQRY5MQ, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.205565147 (127h59m22.033273544s) [noise=true , address=45.91.116.8:4055     , piece_id=2T5CFK4SNTWTOMNOODRHZNDSUEGSHB3GQHGABU72UZWDB5IZZ22Q, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.206302474 (127h59m22.034010875s) [noise=true , address=145.79.227.22:4532   , piece_id=L23HXCNLZYEG2Q7JPU7HEJNOOSXSF2AQD4C2QQSADGTE2AQ7OY5Q, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.206916749 (127h59m22.03462514s) [noise=true , address=5.231.73.3:4023      , piece_id=EOLP27WLTHE7JLZ3LVFCPEOLO6GLVUIHYBRZ4VXR4RU3M72NF62Q, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.208749206 (127h59m22.036457597s) [noise=true , address=145.79.227.33:4900   , piece_id=YCFEPBBRHW33EXUPR3SNLK7C7GN53G7GOQ675CBQVCTM23W7O2IQ, seg_pos={0 0}, upload=133101]: Uploading piece...
Dec 10 23:27:21.274079246 (127h59m22.101787647s) [upload=133101]: Next returned nil segment
Dec 10 23:27:21.274097344 (127h59m22.101805746s) [upload=133101]: Waiting for error group managing segments...
Dec 10 23:27:21.277918982 (127h59m22.105627373s) [noise=true , address=45.91.116.9:4274     , piece_id=MWMFGSNEJTTPGJSSZTM3LWXQ5VTHVF3PTR3WZYDJUSXQVSQRY5MQ, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:27:21.279903714 (127h59m22.107612112s) [noise=true , address=145.79.227.23:4560   , piece_id=2CPE7D53EIOS5BRGGFYEWW4ECSEIHE2HRJX43QL5V5ZI6UMMBBSA, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:27:21.283340577 (127h59m22.111048968s) [noise=true , address=145.79.227.33:4900   , piece_id=YCFEPBBRHW33EXUPR3SNLK7C7GN53G7GOQ675CBQVCTM23W7O2IQ, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:27:21.293860834 (127h59m22.121569232s) [noise=true , address=45.91.116.12:4250    , piece_id=ZUD7CUHQMK64WECIKYLQKX2776YLKJMMFAQXXYM75FIPYZESUIIA, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:27:21.293895398 (127h59m22.12160379s) [noise=true , address=145.79.227.22:4532   , piece_id=L23HXCNLZYEG2Q7JPU7HEJNOOSXSF2AQD4C2QQSADGTE2AQ7OY5Q, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:27:21.294391960 (127h59m22.122100352s) [noise=true , address=145.79.227.27:4692   , piece_id=OMJDRWAWUO2DI62WMHNQRT3ZNS6CUO7JISAY6OIXSQWQHHCDKETA, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:27:21.304590325 (127h59m22.132298722s) [noise=true , address=45.91.116.7:4013     , piece_id=ZO2SW73HZEWVVZK3VWPAK5KOGX2YPR5BIZAN6N6HWYAS2MHWXDIA, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:27:21.360902193 (127h59m22.188610589s) [noise=true , address=5.231.73.3:4023      , piece_id=EOLP27WLTHE7JLZ3LVFCPEOLO6GLVUIHYBRZ4VXR4RU3M72NF62Q, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:27:21.883467012 (127h59m22.711175404s) [noise=true , address=45.91.116.8:4055     , piece_id=2T5CFK4SNTWTOMNOODRHZNDSUEGSHB3GQHGABU72UZWDB5IZZ22Q, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:27:27.317384032 (127h59m28.145092433s) [noise=true , address=64.49.13.169:4707    , piece_id=KST7M546EJOHVBKOSE3US2MYN6X6LWOWR2MX4DU6XLL3UMBKJFUQ, seg_pos={0 0}, upload=133101]: Done uploading piece. err: <nil>
Dec 10 23:28:21.137664954 (128h0m21.965373355s) [noise=true , address=77.90.31.17:4797     , piece_id=NCP46UWVZIHBSEF2BGXEV7SFB7EZZPUSBBMJNYGIHHIDHVXTKSSQ, seg_pos={0 0}, upload=133101]: Done uploading piece. err: ecclient: upload failed (node:12FNxEAEnP3DqdDb16XaBCdmoqdUPEmMtLHDoTuQDBukr2nQWDW, address:77.90.31.17:4797): protocol: rpc: dial tcp 77.90.31.17:4797: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:21.137861064 (128h0m21.965569462s) [noise=true , address=77.90.31.13:4659     , piece_id=GK6DU5LATBNKMLIT4RBYLVAK5WMDMBTJ2UVWCOAPPP7FPJ4EIN6A, seg_pos={0 0}, upload=133101]: Done uploading piece. err: ecclient: upload failed (node:1ScTVpUJBg1xUCzmg1zKsNQ5AZgRbk65md6hgzst9QQ6Vgj4Fc, address:77.90.31.13:4659): protocol: write tcp 159.223.143.39:37868->77.90.31.13:4659: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:21.138027589 (128h0m21.965735989s) [noise=true , address=77.90.31.21:4882     , piece_id=P2RXPW2IX74KY6I2X4RVSJ4XNKV7MSWWTMZGUTYRT4XQPYNZCBLQ, seg_pos={0 0}, upload=133101]: Done uploading piece. err: ecclient: upload failed (node:1qmk23WxPsi88atKkdoQN3vJ3K1YDfNHYBMgYzcc52VURVA9V1, address:77.90.31.21:4882): protocol: rpc: dial tcp 77.90.31.21:4882: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:21.138070345 (128h0m21.965778744s) [noise=true , address=77.90.31.12:4622     , piece_id=AMJ72HBTQAIDCNG5ZTBJRUQSBIGX65D3FETT2ZSPL4WPLEJBEZDA, seg_pos={0 0}, upload=133101]: Done uploading piece. err: ecclient: upload failed (node:12MQryCwJkVN1JhFm4QqhypX3WoMDR9rdjELj4oYoVbpa6U823Z, address:77.90.31.12:4622): protocol: rpc: dial tcp 77.90.31.12:4622: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:21.138141286 (128h0m21.96584968s) [noise=true , address=77.90.31.10:4538     , piece_id=DO3GTO4XBIQBRJ4QGZVVHWYL2AA5IS5S2ZEOEIEXES23CI72JDAQ, seg_pos={0 0}, upload=133101]: Done uploading piece. err: ecclient: upload failed (node:12kRwLj3eRSu1a8oRSnUF5NuG6sJ9R9qMmFT89CHXMWB11WQD1N, address:77.90.31.10:4538): protocol: write tcp 159.223.143.39:59084->77.90.31.10:4538: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:21.138329688 (128h0m21.966038089s) [noise=true , address=77.90.31.14:4675     , piece_id=KQQEKYEDDZXZ5IWVRZQDTW3I3FMSFLM66I2GQNYW5DT6FWQMO65A, seg_pos={0 0}, upload=133101]: Done uploading piece. err: ecclient: upload failed (node:122RnVXziDxm69JuYuwoeufcUUTdXtbHART8UpbFTPbxC1w543k, address:77.90.31.14:4675): protocol: rpc: dial tcp 77.90.31.14:4675: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:21.138667330 (128h0m21.966375733s) [noise=true , address=77.90.31.11:4556     , piece_id=ACCUGGXRZSI3F2DYCQG6YM4URCHRLRQXNYQXM3JAJQ7IZP6YDESQ, seg_pos={0 0}, upload=133101]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: rpc: dial tcp 77.90.31.11:4556: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:21.138820705 (128h0m21.966529106s) [noise=true , address=77.90.31.11:4571     , piece_id=YAMZRC24OM4DLFP22ADIUVKNZCDCZ2LEQYPDTOO2NZ5U6PPXTV2Q, seg_pos={0 0}, upload=133101]: Done uploading piece. err: ecclient: upload failed (node:12eshfvC8guQXYqSeUqwmycyBbM4ens9W98cktmW7nPzk1D6pwy, address:77.90.31.11:4571): protocol: rpc: dial tcp 77.90.31.11:4571: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:21.138853205 (128h0m21.966561598s) [seg_pos={0 0}, upload=133101]: Done waiting for segment. successful: 10 optimal: 14 errs: <nil>
Dec 10 23:28:21.160976228 (128h0m21.988684626s) [upload=133101]: Done uploading segments...
Dec 10 23:28:21.161055764 (128h0m21.988764167s) [upload=133101]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 10)
Duration: 1m0.025457188s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [......................................................X....X]
duration: 
30.001279208s
trace: 
https://jaeger.dev.storj.io/trace/40c8a6c09ccb5923
FAIL (2025-12-10 23:28:21 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001300446s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [......................................................XX..XX]
duration: 
1m0.022334505s
trace: 
https://jaeger.dev.storj.io/trace/23ee5292fcca1989
FAIL (2025-12-10 23:28:13 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
Dec 10 23:27:13.257957048 (127h59m14.085665441s) [upload=133097]: Starting upload
Dec 10 23:27:13.258012839 (127h59m14.08572124s) [upload=133097]: Done starting upload
Dec 10 23:27:13.258238408 (127h59m14.085946786s) [upload=133097]: Uploading segments...
Dec 10 23:27:13.258329274 (127h59m14.086037668s) [upload=133097]: Got next segment. Inline: false
Dec 10 23:27:13.258374487 (127h59m14.086082866s) [upload=133097]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:27:13.258378993 (127h59m14.086087371s) [upload=133097]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:27:13.282722816 (127h59m14.110431208s) [seg_pos={0 0}, upload=133097]: Begin upload segment...
Dec 10 23:27:13.282789806 (127h59m14.110498198s) [seg_pos={0 0}, upload=133097]: Done begin upload segment.
Dec 10 23:27:13.282965578 (127h59m14.110673969s) [noise=true , address=145.79.227.44:4222   , piece_id=44DE5WDM5EIY44NZGVRD4NL356W6BSHBI3Z2WMMSIVIU5MDJTTAA, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.282999645 (127h59m14.110708037s) [noise=true , address=145.79.227.6:4290    , piece_id=JHVCXUNN66YJRONCFFLLU3SK27BTDJGMBYINKBHFDYUMJJEACT7Q, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.283811417 (127h59m14.111519818s) [noise=true , address=145.79.227.49:4347   , piece_id=ESGLRFYKILNJWT23SHBJR7GKOQO7XMI246AFT2ZB4YAGKLENJUBA, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.284755544 (127h59m14.112463939s) [noise=true , address=145.79.227.25:4629   , piece_id=MEQZF7UVGJ3535YF5ETODE4ROMOIC5ZQI3QCNCNBSRGGYAVPE77Q, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.285027919 (127h59m14.112736311s) [noise=true , address=145.79.227.8:4334    , piece_id=X5VDVY3RXTGLMHKAWP3OVIHR7HID2W3DYLYOTSFOEGUITC2ONTSQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.285486536 (127h59m14.11319493s) [noise=true , address=145.79.227.34:4927   , piece_id=XJTMOH7JELUUKFSQA7E77LMRGC6U664F52FV3KOBSMTTJXTKCTRQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.285717877 (127h59m14.113426271s) [noise=true , address=77.90.31.11:4576     , piece_id=DJIBKV6JKGBQ4C5BNQ2WS43UP4SHHRGJ36HQLE7HJXJVDTXEFOSQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.286072587 (127h59m14.113780965s) [noise=true , address=77.90.31.17:4789     , piece_id=WBIGIFCLCUIILHULMVEDCS4VNR2GPRRK57FX55BAJHSUNAKHXA6Q, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.286298556 (127h59m14.114006968s) [noise=true , address=45.91.116.7:4037     , piece_id=T3ZLIFUAQSHQI6GQWFFSPU33BGMJUDAXDR2D7PZP7JVNR4R2UJNQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.286658757 (127h59m14.114367134s) [noise=true , address=45.91.116.6:4985     , piece_id=YTDKLID6J7ZUX4B4FSPEPVWUAQTZYO6ORRZCP4RVEYGN5OYRJLYQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.286816411 (127h59m14.114524802s) [noise=true , address=5.231.73.5:4021      , piece_id=HDYHEDXOAVMIECRJP7JYQLKRLIRZW5HJ25FH6SKAYTQ6SOU5UVIQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.287204378 (127h59m14.114912769s) [noise=true , address=45.91.116.14:4197    , piece_id=TPZXECD4J553R3WZDUFDWWVDLAPQRODDHXXAHRNMQH7HNBEC7RXA, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.287426338 (127h59m14.11513473s) [noise=true , address=77.90.31.15:4720     , piece_id=GHGTLNXAMAT6MST6YFHVSASTDMUHL5PNXTTQC3OYZD3EBPI73PJQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.287719298 (127h59m14.115427692s) [noise=true , address=77.90.31.17:4800     , piece_id=AYTI255TTCLP57ID3HXPTAFW3PO2Z6ICEZ3IYSINS6R3GPEENEDQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.288108064 (127h59m14.115816454s) [noise=true , address=77.90.31.18:4840     , piece_id=5VWRP5YMP46SZLPQM3M7WYSRRF47SMWQTJAPB2ZEGKABPATABKCQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.288329449 (127h59m14.116037841s) [noise=true , address=145.79.227.36:4547   , piece_id=IQ6B55J4FS67N76CRNKJCU7J4RJN4TNDWLOK3RKUMSXMTSJOS6WQ, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.288779004 (127h59m14.116487451s) [noise=true , address=77.90.31.14:4694     , piece_id=BSSUNZJMA37DCMDFMPAB4TD6WDNIH2S55G4HRRI3FVPTXZ35IEUA, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.289410005 (127h59m14.117118407s) [noise=true , address=5.231.73.4:4023      , piece_id=PBGHIEVGEXXLJRCNPS3E2KTDICLB5WFGAS7W3JCZ42DIAKT7IM5A, seg_pos={0 0}, upload=133097]: Uploading piece...
Dec 10 23:27:13.349131035 (127h59m14.17683942s) [upload=133097]: Next returned nil segment
Dec 10 23:27:13.349157341 (127h59m14.176865732s) [upload=133097]: Waiting for error group managing segments...
Dec 10 23:27:13.357434072 (127h59m14.185142474s) [noise=true , address=145.79.227.49:4347   , piece_id=ESGLRFYKILNJWT23SHBJR7GKOQO7XMI246AFT2ZB4YAGKLENJUBA, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.358975349 (127h59m14.186683751s) [noise=true , address=145.79.227.36:4547   , piece_id=IQ6B55J4FS67N76CRNKJCU7J4RJN4TNDWLOK3RKUMSXMTSJOS6WQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.359733413 (127h59m14.187441803s) [noise=true , address=145.79.227.8:4334    , piece_id=X5VDVY3RXTGLMHKAWP3OVIHR7HID2W3DYLYOTSFOEGUITC2ONTSQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.360124225 (127h59m14.187832619s) [noise=true , address=145.79.227.34:4927   , piece_id=XJTMOH7JELUUKFSQA7E77LMRGC6U664F52FV3KOBSMTTJXTKCTRQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.368150844 (127h59m14.195859242s) [noise=true , address=45.91.116.7:4037     , piece_id=T3ZLIFUAQSHQI6GQWFFSPU33BGMJUDAXDR2D7PZP7JVNR4R2UJNQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.370061195 (127h59m14.197769591s) [noise=true , address=45.91.116.6:4985     , piece_id=YTDKLID6J7ZUX4B4FSPEPVWUAQTZYO6ORRZCP4RVEYGN5OYRJLYQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.375071046 (127h59m14.202779437s) [noise=true , address=45.91.116.14:4197    , piece_id=TPZXECD4J553R3WZDUFDWWVDLAPQRODDHXXAHRNMQH7HNBEC7RXA, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.376033437 (127h59m14.203741832s) [noise=true , address=145.79.227.25:4629   , piece_id=MEQZF7UVGJ3535YF5ETODE4ROMOIC5ZQI3QCNCNBSRGGYAVPE77Q, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.389020814 (127h59m14.216729204s) [noise=true , address=145.79.227.6:4290    , piece_id=JHVCXUNN66YJRONCFFLLU3SK27BTDJGMBYINKBHFDYUMJJEACT7Q, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.441128658 (127h59m14.26883705s) [noise=true , address=5.231.73.4:4023      , piece_id=PBGHIEVGEXXLJRCNPS3E2KTDICLB5WFGAS7W3JCZ42DIAKT7IM5A, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:13.447227503 (127h59m14.274935896s) [noise=true , address=5.231.73.5:4021      , piece_id=HDYHEDXOAVMIECRJP7JYQLKRLIRZW5HJ25FH6SKAYTQ6SOU5UVIQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:27:14.315782383 (127h59m15.143490776s) [noise=true , address=145.79.227.44:4222   , piece_id=44DE5WDM5EIY44NZGVRD4NL356W6BSHBI3Z2WMMSIVIU5MDJTTAA, seg_pos={0 0}, upload=133097]: Done uploading piece. err: <nil>
Dec 10 23:28:13.207151012 (128h0m14.034859415s) [noise=true , address=77.90.31.14:4694     , piece_id=BSSUNZJMA37DCMDFMPAB4TD6WDNIH2S55G4HRRI3FVPTXZ35IEUA, seg_pos={0 0}, upload=133097]: Done uploading piece. err: ecclient: upload failed (node:12qRMWzWyft2skqPXqUgPp41JY8faKf5K2En25vFdxp5dArE5SV, address:77.90.31.14:4694): protocol: rpc: dial tcp 77.90.31.14:4694: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:13.207324524 (128h0m14.035032924s) [noise=true , address=77.90.31.17:4800     , piece_id=AYTI255TTCLP57ID3HXPTAFW3PO2Z6ICEZ3IYSINS6R3GPEENEDQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: ecclient: upload failed (node:1TxoPpye17ET1GR52xy2EmkUdq83x4T9TsfuwrKr8cYXf3HLYt, address:77.90.31.17:4800): protocol: rpc: dial tcp 77.90.31.17:4800: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:13.207435662 (128h0m14.035144059s) [noise=true , address=77.90.31.15:4720     , piece_id=GHGTLNXAMAT6MST6YFHVSASTDMUHL5PNXTTQC3OYZD3EBPI73PJQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: ecclient: upload failed (node:12VbsxFqMB3vVphSAJqYpbBzua7Goq45E6ovJSaExkpLtfkcc74, address:77.90.31.15:4720): protocol: rpc: dial tcp 77.90.31.15:4720: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:13.207557827 (128h0m14.035266224s) [noise=true , address=77.90.31.18:4840     , piece_id=5VWRP5YMP46SZLPQM3M7WYSRRF47SMWQTJAPB2ZEGKABPATABKCQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: ecclient: upload failed (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V, address:77.90.31.18:4840): protocol: write tcp 159.223.143.39:42970->77.90.31.18:4840: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:13.207595776 (128h0m14.035304167s) [noise=true , address=77.90.31.17:4789     , piece_id=WBIGIFCLCUIILHULMVEDCS4VNR2GPRRK57FX55BAJHSUNAKHXA6Q, seg_pos={0 0}, upload=133097]: Done uploading piece. err: ecclient: upload failed (node:1yBCEYPaZNi4HA8Kt6JPgnAtZ4FCkrEs28yTknjmBpG6A6wCTx, address:77.90.31.17:4789): protocol: write tcp 159.223.143.39:59896->77.90.31.17:4789: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:13.207867890 (128h0m14.035576289s) [noise=true , address=77.90.31.11:4576     , piece_id=DJIBKV6JKGBQ4C5BNQ2WS43UP4SHHRGJ36HQLE7HJXJVDTXEFOSQ, seg_pos={0 0}, upload=133097]: Done uploading piece. err: ecclient: upload failed (node:1br8Q73A3rDz8b6fZxop71zh5vdEcdye9D7ta8aBpsctwLBfAv, address:77.90.31.11:4576): protocol: rpc: dial tcp 77.90.31.11:4576: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:28:13.207905228 (128h0m14.035613619s) [seg_pos={0 0}, upload=133097]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Dec 10 23:28:13.227004991 (128h0m14.054713386s) [upload=133097]: Done uploading segments...
Dec 10 23:28:13.227071750 (128h0m14.054780148s) [upload=133097]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1m0.02234797s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [....................................................XXX.X...]
duration: 
480.292261ms
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:27:57 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 480.339896ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [.....................................................XXX....]
duration: 
734.684012ms
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:27:38 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 734.711499ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration: 
1m0.023656636s
trace: 
https://jaeger.dev.storj.io/trace/42a40938fd170b6d
FAIL (2025-12-10 23:27:21 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
10 23:26:21.040805421 (127h58m21.868513798s) [upload=133083]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:26:21.040809715 (127h58m21.868518106s) [upload=133083]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:26:21.068633345 (127h58m21.896341724s) [seg_pos={0 0}, upload=133083]: Begin upload segment...
Dec 10 23:26:21.068680293 (127h58m21.89638869s) [seg_pos={0 0}, upload=133083]: Done begin upload segment.
Dec 10 23:26:21.068710086 (127h58m21.896418482s) [noise=true , address=5.231.73.2:4016      , piece_id=S3CPWQGDMTC3HUNN4Y3Z74GQIDANGBGQPARI735ZAWF2RHM5AKYQ, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.071221893 (127h58m21.898930289s) [noise=true , address=145.79.227.22:4523   , piece_id=HGCTGFYWHFCKBHNFVUHYBKPAWK7K5RBJLZNHPRIH4CHI2KIZ46BA, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.072167680 (127h58m21.899876077s) [noise=true , address=77.90.31.19:4856     , piece_id=YPIUY724FWAEVBRWEJET6Q637M446KQ2UOXYV4ABQBOQUD2PHJQQ, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.072669407 (127h58m21.900377807s) [noise=true , address=77.90.31.15:4711     , piece_id=U2ATOKGYRFO3EWRFLQOCOAX3M5X2QMJ2HDJO7UFIG53LH2K5DJRQ, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.072846653 (127h58m21.900555035s) [noise=true , address=5.231.73.3:4008      , piece_id=CWORKEKAXE6ID6EJ3XUAIWVBANQ6QEMF6VGXI3SVVYZ6FXV74FOA, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.073055593 (127h58m21.900763984s) [noise=true , address=64.49.13.170:4722    , piece_id=O54QH6OFPWT4AT4XIKNGKAIATAZFIC5TLBLSKXQN2PO6WIADXDLQ, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.073325248 (127h58m21.901033639s) [noise=true , address=145.79.227.51:4414   , piece_id=DXPCTVADVOMM7JMIDL6T5DG7H6GKB6D35Y2FOMHQHKYEY27RQQ6Q, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.073395990 (127h58m21.901104385s) [noise=true , address=77.90.31.18:4818     , piece_id=NDWYS6USVF537RNIMEDO4EBDCWYUTFU5IEFDDWFHDT2E7OSIV56Q, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.073717026 (127h58m21.901425419s) [noise=true , address=45.91.116.9:4281     , piece_id=G7PKL7QMSQHY3VWL4ULOZ2I4PL5KXDXKEP27PWQJXD2P5O33J3FA, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.073731805 (127h58m21.901440198s) [noise=true , address=77.90.31.19:4850     , piece_id=KEKJHVVFEJQYTUHA5O3NXTMYTVJIAW347RRNDO2CH3QREFUK5QWQ, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.074030269 (127h58m21.901738664s) [noise=true , address=45.91.116.12:4247    , piece_id=4VWHVM6AWQ4PNZPFKXNOHCS4NF5753TSDKMUZFQREJKKFRQ7VXMQ, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.074086501 (127h58m21.901794878s) [noise=true , address=145.79.227.20:4471   , piece_id=54ENI25RCX7QWCF3J4WN2PVDAODCFU5USLELTCJAA5B5KCMT6UQA, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.074363322 (127h58m21.9020717s) [noise=true , address=145.79.227.28:4751   , piece_id=6ZWTKZIV5JVJD5USWCUNVRHF6ZUPGO6XYDNATF7BXFR3JKWURP2A, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.074582040 (127h58m21.902290421s) [noise=true , address=45.91.116.11:4150    , piece_id=ZBMK6GOTM5EQT4FJGQBTPUOLHX4XZCP23GH2VDSGBJNKWGLTVZZA, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.074697265 (127h58m21.902405661s) [noise=true , address=145.79.227.12:4780   , piece_id=HZOZPBEBMTPI2KMBCDDIRDEYDMQKTD3SZOUP7WDQMCJ2NAK3BY4Q, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.075057198 (127h58m21.902765591s) [noise=true , address=77.90.31.13:4637     , piece_id=6T4726CLZN5C4MSPY5QKPP37DVMOYVWF6AGCZNR5J5VX3ZJA2ITA, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.075086269 (127h58m21.90279466s) [noise=true , address=145.79.227.40:4064   , piece_id=QWMUURQS4OCFCF5V4Q2JJOXVU5DFYQ7OZ6AZQR4QBRCNI2CHEDMQ, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.075596570 (127h58m21.903304952s) [noise=true , address=145.79.227.30:4777   , piece_id=5STEEYCNBDNO3I3PNTZAU6OHLOK6YB24QDYRORCT6NZABXKKF3NQ, seg_pos={0 0}, upload=133083]: Uploading piece...
Dec 10 23:26:21.133909414 (127h58m21.961617792s) [upload=133083]: Next returned nil segment
Dec 10 23:26:21.133921260 (127h58m21.961629652s) [upload=133083]: Waiting for error group managing segments...
Dec 10 23:26:21.138843694 (127h58m21.966552084s) [noise=true , address=45.91.116.12:4247    , piece_id=4VWHVM6AWQ4PNZPFKXNOHCS4NF5753TSDKMUZFQREJKKFRQ7VXMQ, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.139694188 (127h58m21.967402566s) [noise=true , address=145.79.227.20:4471   , piece_id=54ENI25RCX7QWCF3J4WN2PVDAODCFU5USLELTCJAA5B5KCMT6UQA, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.140149124 (127h58m21.967857515s) [noise=true , address=145.79.227.51:4414   , piece_id=DXPCTVADVOMM7JMIDL6T5DG7H6GKB6D35Y2FOMHQHKYEY27RQQ6Q, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.140532336 (127h58m21.968240727s) [noise=true , address=145.79.227.12:4780   , piece_id=HZOZPBEBMTPI2KMBCDDIRDEYDMQKTD3SZOUP7WDQMCJ2NAK3BY4Q, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.141577720 (127h58m21.969286112s) [noise=true , address=145.79.227.22:4523   , piece_id=HGCTGFYWHFCKBHNFVUHYBKPAWK7K5RBJLZNHPRIH4CHI2KIZ46BA, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.146982843 (127h58m21.974691223s) [noise=true , address=145.79.227.28:4751   , piece_id=6ZWTKZIV5JVJD5USWCUNVRHF6ZUPGO6XYDNATF7BXFR3JKWURP2A, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.152317018 (127h58m21.980025409s) [noise=true , address=45.91.116.9:4281     , piece_id=G7PKL7QMSQHY3VWL4ULOZ2I4PL5KXDXKEP27PWQJXD2P5O33J3FA, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.153953991 (127h58m21.981662383s) [noise=true , address=45.91.116.11:4150    , piece_id=ZBMK6GOTM5EQT4FJGQBTPUOLHX4XZCP23GH2VDSGBJNKWGLTVZZA, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.250207858 (127h58m22.077916249s) [noise=true , address=5.231.73.3:4008      , piece_id=CWORKEKAXE6ID6EJ3XUAIWVBANQ6QEMF6VGXI3SVVYZ6FXV74FOA, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.250659615 (127h58m22.078368009s) [noise=true , address=5.231.73.2:4016      , piece_id=S3CPWQGDMTC3HUNN4Y3Z74GQIDANGBGQPARI735ZAWF2RHM5AKYQ, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.372266863 (127h58m22.199975244s) [noise=true , address=145.79.227.40:4064   , piece_id=QWMUURQS4OCFCF5V4Q2JJOXVU5DFYQ7OZ6AZQR4QBRCNI2CHEDMQ, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:21.703516387 (127h58m22.531224778s) [noise=true , address=64.49.13.170:4722    , piece_id=O54QH6OFPWT4AT4XIKNGKAIATAZFIC5TLBLSKXQN2PO6WIADXDLQ, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:26:22.134632245 (127h58m22.962340635s) [noise=true , address=145.79.227.30:4777   , piece_id=5STEEYCNBDNO3I3PNTZAU6OHLOK6YB24QDYRORCT6NZABXKKF3NQ, seg_pos={0 0}, upload=133083]: Done uploading piece. err: <nil>
Dec 10 23:27:21.010474821 (127h59m21.83818323s) [noise=true , address=77.90.31.18:4818     , piece_id=NDWYS6USVF537RNIMEDO4EBDCWYUTFU5IEFDDWFHDT2E7OSIV56Q, seg_pos={0 0}, upload=133083]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: write tcp 159.223.143.39:55284->77.90.31.18:4818: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:21.011080939 (127h59m21.838789333s) [noise=true , address=77.90.31.19:4856     , piece_id=YPIUY724FWAEVBRWEJET6Q637M446KQ2UOXYV4ABQBOQUD2PHJQQ, seg_pos={0 0}, upload=133083]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: write tcp 159.223.143.39:37548->77.90.31.19:4856: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:21.011239142 (127h59m21.838947532s) [noise=true , address=77.90.31.13:4637     , piece_id=6T4726CLZN5C4MSPY5QKPP37DVMOYVWF6AGCZNR5J5VX3ZJA2ITA, seg_pos={0 0}, upload=133083]: Done uploading piece. err: ecclient: upload failed (node:12Myourwn6UnUxVkxzBdRJApeAGNrZzjrgLgzAfki6x9JZ1Fy17, address:77.90.31.13:4637): protocol: write tcp 159.223.143.39:49382->77.90.31.13:4637: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:21.011421630 (127h59m21.83913003s) [noise=true , address=77.90.31.15:4711     , piece_id=U2ATOKGYRFO3EWRFLQOCOAX3M5X2QMJ2HDJO7UFIG53LH2K5DJRQ, seg_pos={0 0}, upload=133083]: Done uploading piece. err: ecclient: upload failed (node:12J2weU7Bmsr3RdQQ9QMuadT96XReBkyxTeaLJ2SEqVGGFX1PWu, address:77.90.31.15:4711): protocol: rpc: dial tcp 77.90.31.15:4711: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:21.011565685 (127h59m21.839274078s) [noise=true , address=77.90.31.19:4850     , piece_id=KEKJHVVFEJQYTUHA5O3NXTMYTVJIAW347RRNDO2CH3QREFUK5QWQ, seg_pos={0 0}, upload=133083]: Done uploading piece. err: ecclient: upload failed (node:12oGsNdVAKAabvVuWFZ2mpydVYjzhJycig4cqdcE5oAS2YsHmYv, address:77.90.31.19:4850): protocol: write tcp 159.223.143.39:34002->77.90.31.19:4850: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:21.011606481 (127h59m21.839314872s) [seg_pos={0 0}, upload=133083]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Dec 10 23:27:21.032115369 (127h59m21.859823784s) [upload=133083]: Done uploading segments...
Dec 10 23:27:21.032156383 (127h59m21.859864777s) [upload=133083]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.023676158s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [.......................................................XX..X]
duration: 
1m0.023993397s
trace: 
https://jaeger.dev.storj.io/trace/30e86b2f196af029
FAIL (2025-12-10 23:27:13 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
Dec 10 23:26:13.017345946 (127h58m13.845054338s) [upload=133082]: Starting upload
Dec 10 23:26:13.017401091 (127h58m13.845109469s) [upload=133082]: Done starting upload
Dec 10 23:26:13.017458669 (127h58m13.845167062s) [upload=133082]: Uploading segments...
Dec 10 23:26:13.017744073 (127h58m13.845452465s) [upload=133082]: Got next segment. Inline: false
Dec 10 23:26:13.017795239 (127h58m13.845503618s) [upload=133082]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:26:13.017800376 (127h58m13.845508766s) [upload=133082]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:26:13.044387098 (127h58m13.8720955s) [seg_pos={0 0}, upload=133082]: Begin upload segment...
Dec 10 23:26:13.044440804 (127h58m13.872149198s) [seg_pos={0 0}, upload=133082]: Done begin upload segment.
Dec 10 23:26:13.044546630 (127h58m13.872255033s) [noise=true , address=77.90.31.15:4728     , piece_id=TCQCVYPGJZBED4RQUFCBADYGD6FRTERNLGP7YIV5OCIMWGTIA2RA, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.046606080 (127h58m13.874314477s) [noise=true , address=145.79.227.52:4452   , piece_id=FOAXJSSD4ZKC5EWFV4PK3FXYU7VPVAMYYLCLFN27XIYUI3ZZB3SA, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.047302889 (127h58m13.875011291s) [noise=true , address=77.90.31.17:4787     , piece_id=6TGGVJXM5CCKMZPEVIJI5MGW3YORYLSG55VMNRLG32LSUBLLZCQA, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.047443819 (127h58m13.87515222s) [noise=true , address=145.79.227.43:4182   , piece_id=RP5YLAKA6FH64JRBUIBXE5EGVWXLTHQDFPKCSQHYVUDKMAXLJQNA, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.047821429 (127h58m13.875529832s) [noise=true , address=45.91.116.6:4982     , piece_id=YJTPG4JFGVIM3UDV4U6NJHNWUEJTDIXJXVCDD3OVOANDYNCAUQ3A, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.047920827 (127h58m13.875629221s) [noise=true , address=45.91.116.14:4215    , piece_id=RM3PXVULIBLIQKI4TRAH6574AQWMXUEYRDDG7F4PARJEU7KJSI7A, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.048250433 (127h58m13.875958835s) [noise=true , address=45.91.116.8:4068     , piece_id=34XCCEMOW6OA6OF54C7MVGNSKUF5O44OB4SFU3NCNNPIYN3D4LTA, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.048350896 (127h58m13.87605929s) [noise=true , address=145.79.227.16:4943   , piece_id=JU6Q6KY2RQRBFIIMIA5K5OLM3DJNYYYPNSNHLYCTCKGQUX5JTFSQ, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.048695841 (127h58m13.876404238s) [noise=true , address=64.49.13.169:4708    , piece_id=EM7FO4MP7FKLBSYGKNGZ5ER7S7CXWHLEPBZY2BSQHNRRQK7MYI7A, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.048825938 (127h58m13.876534333s) [noise=true , address=145.79.227.47:4285   , piece_id=NK7RM53QXK3JRB6NWWCJQCTO4363XJDAZBIRTOTPIT3HBCQSHCBA, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.049226552 (127h58m13.876934951s) [noise=true , address=77.90.31.11:4573     , piece_id=ZUVISDIK5CFVYUWOVAGS4F4KH2OWFMXIXDVR7G3LJXRID4CTXZGA, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.049655863 (127h58m13.877364265s) [noise=true , address=145.79.227.30:4782   , piece_id=5QVFRZG32DHV5NIMJM2XT63ABFJ6P4D4TLGLZCBT3G73DCRPHYNA, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.050123183 (127h58m13.87783158s) [noise=true , address=145.79.227.31:4807   , piece_id=URSL6NOAGLDUIGDODII4VKULIBY2M2SSIKEEFUXP5J2PRPRHAOMA, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.050625650 (127h58m13.878334044s) [noise=true , address=45.91.116.11:4123    , piece_id=5DZRPLLBXYSHACHRGM6UOV3BXLFBJAWKI2M57L2FNL3NBJPQ25NQ, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.051099189 (127h58m13.878807583s) [noise=true , address=77.90.31.12:4617     , piece_id=KQYOA2SU2P2DZ4TLVE27DF723K5STTSQVNRW65YSXP7X3AQ7FT4A, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.051506762 (127h58m13.879215156s) [noise=true , address=145.79.227.44:4216   , piece_id=TEFOBIAGGGVKW5FDLYH5FMBWXBVNDNZPARZOJSQ6I7FRGKSZUOXQ, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.051939598 (127h58m13.879647989s) [noise=true , address=77.90.31.19:4844     , piece_id=53M3OPBNLH2SYI7KG4666MYUZN3IFSNV3OYGSWC2CUFDTWQKZY6Q, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.052312621 (127h58m13.880021013s) [noise=true , address=77.90.31.13:4633     , piece_id=MYLY6AEXHTQM4HSG3RMVTEXK75AKDV2LFNAR7Y6AL4B6WNCITR2Q, seg_pos={0 0}, upload=133082]: Uploading piece...
Dec 10 23:26:13.119554580 (127h58m13.947262958s) [upload=133082]: Next returned nil segment
Dec 10 23:26:13.119568825 (127h58m13.947277222s) [upload=133082]: Waiting for error group managing segments...
Dec 10 23:26:13.126032681 (127h58m13.953741073s) [noise=true , address=45.91.116.6:4982     , piece_id=YJTPG4JFGVIM3UDV4U6NJHNWUEJTDIXJXVCDD3OVOANDYNCAUQ3A, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:13.129135253 (127h58m13.956843644s) [noise=true , address=145.79.227.47:4285   , piece_id=NK7RM53QXK3JRB6NWWCJQCTO4363XJDAZBIRTOTPIT3HBCQSHCBA, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:13.130176218 (127h58m13.957884609s) [noise=true , address=145.79.227.31:4807   , piece_id=URSL6NOAGLDUIGDODII4VKULIBY2M2SSIKEEFUXP5J2PRPRHAOMA, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:13.140703602 (127h58m13.968411992s) [noise=true , address=45.91.116.14:4215    , piece_id=RM3PXVULIBLIQKI4TRAH6574AQWMXUEYRDDG7F4PARJEU7KJSI7A, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:13.141067617 (127h58m13.968776008s) [noise=true , address=45.91.116.8:4068     , piece_id=34XCCEMOW6OA6OF54C7MVGNSKUF5O44OB4SFU3NCNNPIYN3D4LTA, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:13.143137574 (127h58m13.970845966s) [noise=true , address=45.91.116.11:4123    , piece_id=5DZRPLLBXYSHACHRGM6UOV3BXLFBJAWKI2M57L2FNL3NBJPQ25NQ, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:13.143315046 (127h58m13.971023437s) [noise=true , address=145.79.227.43:4182   , piece_id=RP5YLAKA6FH64JRBUIBXE5EGVWXLTHQDFPKCSQHYVUDKMAXLJQNA, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:13.155901567 (127h58m13.98360995s) [noise=true , address=145.79.227.52:4452   , piece_id=FOAXJSSD4ZKC5EWFV4PK3FXYU7VPVAMYYLCLFN27XIYUI3ZZB3SA, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:14.066824199 (127h58m14.894532594s) [noise=true , address=145.79.227.44:4216   , piece_id=TEFOBIAGGGVKW5FDLYH5FMBWXBVNDNZPARZOJSQ6I7FRGKSZUOXQ, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:14.126912262 (127h58m14.954620653s) [noise=true , address=145.79.227.30:4782   , piece_id=5QVFRZG32DHV5NIMJM2XT63ABFJ6P4D4TLGLZCBT3G73DCRPHYNA, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:14.548149818 (127h58m15.375858212s) [noise=true , address=145.79.227.16:4943   , piece_id=JU6Q6KY2RQRBFIIMIA5K5OLM3DJNYYYPNSNHLYCTCKGQUX5JTFSQ, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:26:19.113242591 (127h58m19.940950985s) [noise=true , address=64.49.13.169:4708    , piece_id=EM7FO4MP7FKLBSYGKNGZ5ER7S7CXWHLEPBZY2BSQHNRRQK7MYI7A, seg_pos={0 0}, upload=133082]: Done uploading piece. err: <nil>
Dec 10 23:27:12.986549356 (127h59m13.814257755s) [noise=true , address=77.90.31.15:4728     , piece_id=TCQCVYPGJZBED4RQUFCBADYGD6FRTERNLGP7YIV5OCIMWGTIA2RA, seg_pos={0 0}, upload=133082]: Done uploading piece. err: ecclient: upload failed (node:152bVnKGB6XVkvkjrWDsivCMxEPXq3tesh1srTzXZBcuEohFDo, address:77.90.31.15:4728): protocol: rpc: dial tcp 77.90.31.15:4728: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:12.986796149 (127h59m13.814504541s) [noise=true , address=77.90.31.13:4633     , piece_id=MYLY6AEXHTQM4HSG3RMVTEXK75AKDV2LFNAR7Y6AL4B6WNCITR2Q, seg_pos={0 0}, upload=133082]: Done uploading piece. err: ecclient: upload failed (node:12qXhyMbfXELW1Vg5z9NpqFX1fm3v2pGEaA56qSc8kHefPNNNYs, address:77.90.31.13:4633): protocol: write tcp 159.223.143.39:38448->77.90.31.13:4633: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:12.986985362 (127h59m13.814693756s) [noise=true , address=77.90.31.17:4787     , piece_id=6TGGVJXM5CCKMZPEVIJI5MGW3YORYLSG55VMNRLG32LSUBLLZCQA, seg_pos={0 0}, upload=133082]: Done uploading piece. err: ecclient: upload failed (node:1Lietonb5aVbaZQt6wQ2EoxwJkSEn9oL9Dwyrc9mTyomEKikNt, address:77.90.31.17:4787): protocol: write tcp 159.223.143.39:55634->77.90.31.17:4787: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:12.987217005 (127h59m13.8149254s) [noise=true , address=77.90.31.11:4573     , piece_id=ZUVISDIK5CFVYUWOVAGS4F4KH2OWFMXIXDVR7G3LJXRID4CTXZGA, seg_pos={0 0}, upload=133082]: Done uploading piece. err: ecclient: upload failed (node:1Q3atbNPC93bXM7pr4KCeea5La9sX4xs2qNwGxNWSrNQs1ftrV, address:77.90.31.11:4573): protocol: write tcp 159.223.143.39:53736->77.90.31.11:4573: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:12.987391599 (127h59m13.815100001s) [noise=true , address=77.90.31.19:4844     , piece_id=53M3OPBNLH2SYI7KG4666MYUZN3IFSNV3OYGSWC2CUFDTWQKZY6Q, seg_pos={0 0}, upload=133082]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: write tcp 159.223.143.39:56718->77.90.31.19:4844: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:12.987470648 (127h59m13.815179042s) [noise=true , address=77.90.31.12:4617     , piece_id=KQYOA2SU2P2DZ4TLVE27DF723K5STTSQVNRW65YSXP7X3AQ7FT4A, seg_pos={0 0}, upload=133082]: Done uploading piece. err: ecclient: upload failed (node:1PpGinvTbgS3cMHoLaMhhyab7L3urApr3DJRJG4SMzWqw8UAPg, address:77.90.31.12:4617): protocol: write tcp 159.223.143.39:57030->77.90.31.12:4617: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:27:12.987499659 (127h59m13.815208044s) [seg_pos={0 0}, upload=133082]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Dec 10 23:27:13.007437099 (127h59m13.835145525s) [upload=133082]: Done uploading segments...
Dec 10 23:27:13.007479692 (127h59m13.835188088s) [upload=133082]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1m0.024015026s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration: 
454.902123ms
trace: 
https://jaeger.dev.storj.io/trace/6e1f15cb7b3e3fe9
FAIL (2025-12-10 23:27:02 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 454.929086ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [.....................................................XXX.X..]
duration: 
444.980151ms
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:27:01 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 445.014876ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [......................................................XXX...]
duration: 
531.580971ms
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:26:46 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 531.608837ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................................X...]
duration: 
494.633384ms
trace: 
https://jaeger.dev.storj.io/trace/6e1f15cb7b3e3fe9
FAIL (2025-12-10 23:26:33 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 494.661565ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [.......................................................XXX..]
duration: 
687.080581ms
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:26:12 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 687.105387ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration: 
1m0.026322774s
trace: 
https://jaeger.dev.storj.io/trace/12eb881e469c95d2
FAIL (2025-12-10 23:26:10 UTC) 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
: Got next segment. Inline: false
Dec 10 23:25:10.930000011 (127h57m11.757708401s) [upload=133066]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:25:10.930012671 (127h57m11.757721073s) [upload=133066]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:25:10.953628122 (127h57m11.781336519s) [seg_pos={0 0}, upload=133066]: Begin upload segment...
Dec 10 23:25:10.953706175 (127h57m11.781414559s) [seg_pos={0 0}, upload=133066]: Done begin upload segment.
Dec 10 23:25:10.953758202 (127h57m11.781466593s) [noise=true , address=145.79.227.52:4457   , piece_id=AF7TOS7CMUQ3UZ5AH5SKYVA7FIFRVCDE5CM2TJ44DZWFD7L4XUEA, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.953772547 (127h57m11.781480942s) [noise=true , address=45.91.116.10:4096    , piece_id=BIVASNTLNEFQU7AHZCROXUO3ZF5KLSAHGITTO723XXZNKRPWYQMA, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.953915163 (127h57m11.781623565s) [noise=true , address=64.49.13.26:4946     , piece_id=WBIEFBBSEHM3B6TKI3GLLEVP74UX7APUYESL6OWHVNPBD3R4TT6Q, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.954394093 (127h57m11.782102494s) [noise=true , address=45.91.116.11:4141    , piece_id=G775MWDSTZ5R4TMVCW4Q7RMHHM73GYD6D6BPMJD5WDV3UNOZCVXQ, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.954603859 (127h57m11.782312258s) [noise=true , address=5.231.73.3:4034      , piece_id=NAXB5JYM3M36TCUMR4LNTC4WVJMEBZC6KRXLQXF5UA3GB4BFLSDQ, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.955094045 (127h57m11.782802443s) [noise=true , address=45.91.116.12:4231    , piece_id=RF7NVF4XPIHJO36X7TDWEXJE2IRA2QDF7R5LI3LSDWWLJVKS7BUA, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.955470558 (127h57m11.783178952s) [noise=true , address=77.90.31.13:4655     , piece_id=BONWDQKAPSMPBBKU6EOFO3ILMZCRXOPNE75QGMNXSUV7PEW3ECSA, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.955526097 (127h57m11.783234499s) [noise=true , address=145.79.227.41:4103   , piece_id=UL36ZJVUTJLYCHAC4WZPZWH354AONUGVMJJTJVMOEJ7YXYJGITTQ, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.955839599 (127h57m11.783548002s) [noise=true , address=145.79.227.49:4356   , piece_id=H2MHEOEUMTXMXBDLYOSKX4TXLUMUDIMVA56D3KJ66ULRFPA27C6Q, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.956103769 (127h57m11.783812172s) [noise=true , address=145.79.227.34:4914   , piece_id=PPTS2XBPHQHQEO76QJFX6X3AHHTGXA7GTOEJWFRPVXTB2MIY5TYA, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.956245735 (127h57m11.783954136s) [noise=true , address=5.231.73.4:4009      , piece_id=A6SHUX2TRGUUE6Z3XYRHXATF33XOP6WQKYDIHQOW566FNWNL7Z7Q, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.956687353 (127h57m11.784395748s) [noise=true , address=77.90.31.19:4849     , piece_id=CSZSCXCKVMWALQNDS6WKRHDBYKGF2ZPJFZUXKAFZ4EFY3HXLTR2A, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.956800809 (127h57m11.784509205s) [noise=true , address=77.90.31.17:4776     , piece_id=FJEUPRF3PRO56KR3R7KDPNVMPUQUPYXANGSY6FMJTCJK4JIC434A, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.957197469 (127h57m11.784905864s) [noise=true , address=145.79.227.30:4789   , piece_id=KQRRPG2OEOL7VLCNTQVID7KAFK57EIVOFNGVEGBVN5LXO637SW3Q, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.957230179 (127h57m11.784938581s) [noise=true , address=145.79.227.33:4893   , piece_id=JOIUJ5DL5A2ZZMZTDVXCM26AR5N4BETNBVPXQRFCEUTGMUUTBSKQ, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.957535688 (127h57m11.78524408s) [noise=true , address=45.91.116.4:4956     , piece_id=7ITC3B6U22DQIDEASV7GAK777DGNQ73Y3BVTL2FVW3TTDG45KMPA, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.957766610 (127h57m11.785475021s) [noise=true , address=77.90.31.12:4604     , piece_id=CA3OZ42QNPVKJJRNB34TNNTYEKTAASCNYGJ432XILLZ7PUXI5EEA, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:10.957863129 (127h57m11.785571514s) [noise=true , address=77.90.31.18:4833     , piece_id=OYBSRCFKCUPGBRQBHPPSGBBWL4XWVDUGSWFPGRI6OZACF2VHV3VQ, seg_pos={0 0}, upload=133066]: Uploading piece...
Dec 10 23:25:11.026168307 (127h57m11.853876691s) [upload=133066]: Next returned nil segment
Dec 10 23:25:11.026180482 (127h57m11.853888873s) [upload=133066]: Waiting for error group managing segments...
Dec 10 23:25:11.030945075 (127h57m11.85865347s) [noise=true , address=45.91.116.11:4141    , piece_id=G775MWDSTZ5R4TMVCW4Q7RMHHM73GYD6D6BPMJD5WDV3UNOZCVXQ, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.031638561 (127h57m11.859346952s) [noise=true , address=45.91.116.10:4096    , piece_id=BIVASNTLNEFQU7AHZCROXUO3ZF5KLSAHGITTO723XXZNKRPWYQMA, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.031678356 (127h57m11.859386759s) [noise=true , address=45.91.116.12:4231    , piece_id=RF7NVF4XPIHJO36X7TDWEXJE2IRA2QDF7R5LI3LSDWWLJVKS7BUA, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.032654889 (127h57m11.860363283s) [noise=true , address=145.79.227.41:4103   , piece_id=UL36ZJVUTJLYCHAC4WZPZWH354AONUGVMJJTJVMOEJ7YXYJGITTQ, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.033150343 (127h57m11.860858734s) [noise=true , address=145.79.227.34:4914   , piece_id=PPTS2XBPHQHQEO76QJFX6X3AHHTGXA7GTOEJWFRPVXTB2MIY5TYA, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.035348512 (127h57m11.863056897s) [noise=true , address=145.79.227.49:4356   , piece_id=H2MHEOEUMTXMXBDLYOSKX4TXLUMUDIMVA56D3KJ66ULRFPA27C6Q, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.036955928 (127h57m11.864664326s) [noise=true , address=145.79.227.33:4893   , piece_id=JOIUJ5DL5A2ZZMZTDVXCM26AR5N4BETNBVPXQRFCEUTGMUUTBSKQ, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.048116304 (127h57m11.875824698s) [noise=true , address=45.91.116.4:4956     , piece_id=7ITC3B6U22DQIDEASV7GAK777DGNQ73Y3BVTL2FVW3TTDG45KMPA, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.049223646 (127h57m11.876932038s) [noise=true , address=145.79.227.52:4457   , piece_id=AF7TOS7CMUQ3UZ5AH5SKYVA7FIFRVCDE5CM2TJ44DZWFD7L4XUEA, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.129201220 (127h57m11.956909611s) [noise=true , address=5.231.73.4:4009      , piece_id=A6SHUX2TRGUUE6Z3XYRHXATF33XOP6WQKYDIHQOW566FNWNL7Z7Q, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.144139068 (127h57m11.971847469s) [noise=true , address=5.231.73.3:4034      , piece_id=NAXB5JYM3M36TCUMR4LNTC4WVJMEBZC6KRXLQXF5UA3GB4BFLSDQ, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.551663378 (127h57m12.379371774s) [noise=true , address=64.49.13.26:4946     , piece_id=WBIEFBBSEHM3B6TKI3GLLEVP74UX7APUYESL6OWHVNPBD3R4TT6Q, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:25:11.935196141 (127h57m12.762904521s) [noise=true , address=145.79.227.30:4789   , piece_id=KQRRPG2OEOL7VLCNTQVID7KAFK57EIVOFNGVEGBVN5LXO637SW3Q, seg_pos={0 0}, upload=133066]: Done uploading piece. err: <nil>
Dec 10 23:26:10.896326553 (127h58m11.724034954s) [noise=true , address=77.90.31.18:4833     , piece_id=OYBSRCFKCUPGBRQBHPPSGBBWL4XWVDUGSWFPGRI6OZACF2VHV3VQ, seg_pos={0 0}, upload=133066]: Done uploading piece. err: ecclient: upload failed (node:1FbVbo8kGy1aaFyCk2noiXNUJHtosFJHFykBMRecGd5Kj5gjEp, address:77.90.31.18:4833): protocol: write tcp 159.223.143.39:51220->77.90.31.18:4833: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:26:10.896420119 (127h58m11.72412852s) [noise=true , address=77.90.31.13:4655     , piece_id=BONWDQKAPSMPBBKU6EOFO3ILMZCRXOPNE75QGMNXSUV7PEW3ECSA, seg_pos={0 0}, upload=133066]: Done uploading piece. err: ecclient: upload failed (node:1K7fQM1NVA1L7ukmDtyWh2DYWypUoj3GbreETZpPL6gXfXmZDD, address:77.90.31.13:4655): protocol: write tcp 159.223.143.39:47104->77.90.31.13:4655: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:26:10.896621450 (127h58m11.724329852s) [noise=true , address=77.90.31.17:4776     , piece_id=FJEUPRF3PRO56KR3R7KDPNVMPUQUPYXANGSY6FMJTCJK4JIC434A, seg_pos={0 0}, upload=133066]: Done uploading piece. err: ecclient: upload failed (node:1278Hwz624uAkvSY2xXZL7NTGcbgEKaPpJuBKp5cC53SW9g4HfQ, address:77.90.31.17:4776): protocol: rpc: dial tcp 77.90.31.17:4776: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:26:10.896799172 (127h58m11.724507569s) [noise=true , address=77.90.31.12:4604     , piece_id=CA3OZ42QNPVKJJRNB34TNNTYEKTAASCNYGJ432XILLZ7PUXI5EEA, seg_pos={0 0}, upload=133066]: Done uploading piece. err: ecclient: upload failed (node:1vK9QCCj1rszVCR72YBc8BdKCPRno49RrcH9uGQb9rBJkZY4F7, address:77.90.31.12:4604): protocol: write tcp 159.223.143.39:48464->77.90.31.12:4604: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:26:10.896855420 (127h58m11.724563818s) [noise=true , address=77.90.31.19:4849     , piece_id=CSZSCXCKVMWALQNDS6WKRHDBYKGF2ZPJFZUXKAFZ4EFY3HXLTR2A, seg_pos={0 0}, upload=133066]: Done uploading piece. err: ecclient: upload failed (node:12F8hBt2nRQBHGzba5pPKyYJF37b7gRUnmBoZfDAYZAkYaUfk2V, address:77.90.31.19:4849): protocol: rpc: dial tcp 77.90.31.19:4849: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:26:10.896880291 (127h58m11.724588668s) [seg_pos={0 0}, upload=133066]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Dec 10 23:26:10.920363542 (127h58m11.748071924s) [upload=133066]: Done uploading segments...
Dec 10 23:26:10.920413974 (127h58m11.748122356s) [upload=133066]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 1m0.026336801s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [......................................................XXX.X.]
duration: 
406.569344ms
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:25:52 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 406.595619ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration: 
476.051994ms
trace: 
https://jaeger.dev.storj.io/trace/6e1f15cb7b3e3fe9
FAIL (2025-12-10 23:25:44 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 476.078979ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [.......................................................XXX.X]
duration: 
5.001237655s
trace: 
https://jaeger.dev.storj.io/trace/f7fdabbdadb81f8
FAIL (2025-12-10 23:25:41 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001261736s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [........................................................XX..]
duration: 
8.035326346s
trace: 
https://jaeger.dev.storj.io/trace/281b0aeb047ea758
FAIL (2025-12-10 23:25:34 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 11)
======LOGS======
Dec 10 23:23:13.301152801 (127h55m14.128861206s) [upload=133034]: Starting upload
Dec 10 23:23:13.301229634 (127h55m14.128938035s) [upload=133034]: Done starting upload
Dec 10 23:23:13.301331508 (127h55m14.129039894s) [upload=133034]: Uploading segments...
Dec 10 23:23:13.301658156 (127h55m14.129366557s) [upload=133034]: Got next segment. Inline: false
Dec 10 23:23:13.301712452 (127h55m14.12942085s) [upload=133034]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 10 23:23:13.301719588 (127h55m14.129427989s) [upload=133034]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:23:13.330274238 (127h55m14.157982632s) [seg_pos={0 0}, upload=133034]: Begin upload segment...
Dec 10 23:23:13.330329359 (127h55m14.158037741s) [seg_pos={0 0}, upload=133034]: Done begin upload segment.
Dec 10 23:23:13.330380877 (127h55m14.158089278s) [noise=true , address=77.90.31.16:4759     , piece_id=FAPWSWNXEBWDR3HQ2UC4IJWLJXWXTXMAL45PBJXK5WC2DWFMUMLA, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.330403047 (127h55m14.158111444s) [noise=true , address=5.231.73.4:4019      , piece_id=E6TH36ECK4CLI6XIGSTCHRR43C2JJ2F5TPGHT4LNVLAXCB43ZQPQ, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.330974370 (127h55m14.15868276s) [noise=true , address=77.90.31.18:4817     , piece_id=I7D2QBX2DIWWL7GIOBQL53UIH2CSYGAP736SUO44NINR7QXK346A, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.331145831 (127h55m14.158854228s) [noise=true , address=145.79.227.16:4915   , piece_id=A7LAA5PWTCXWHN623JJY4TUPQEOWT6ATPOFOAZHX4EGJZANAC2FQ, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.331658530 (127h55m14.159366924s) [noise=true , address=45.91.116.9:4285     , piece_id=3WW4U24AAJ44VBV4Z72MU3CJQLTNCNMRLOQF35AOSD4LUT3G5TDQ, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.332115360 (127h55m14.159823758s) [noise=true , address=77.90.31.14:4685     , piece_id=OTJT52ZNJNFM47EXFY7ULSZBWRU6UITPFFSSX6SU2D6PFBBYATOA, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.332774641 (127h55m14.160483036s) [noise=true , address=64.49.13.139:4473    , piece_id=LN4JYLHZVFBCLLUDGP3O5OWSHUUZNGYGGXAEHBZYAOWGN2NJFMRQ, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.333188387 (127h55m14.160896786s) [noise=true , address=77.90.31.17:4794     , piece_id=S5R766MWUEKFYLZUU24U5UUFWGV2JB22THYCKD6CYNYHGNRYWOCQ, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.333599311 (127h55m14.161307708s) [noise=true , address=145.79.227.23:4577   , piece_id=UZTYJEQMSC3AVGSM7TNWNA5X34E37KQQAL2QRWM22MXCEH2WSJWQ, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.334040103 (127h55m14.161748486s) [noise=true , address=77.90.31.12:4619     , piece_id=HCFOJ54U3CP636I6MV7I5UHSZDUYTU323DBDNLAITEDMMGWOFXAA, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.334492089 (127h55m14.162200488s) [noise=true , address=77.90.31.13:4657     , piece_id=4S2S2BWBDRDRLBSGPMYSPFPGQ7RPYUOPDPIRGDEJC7W5KQL5UPRA, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.335502531 (127h55m14.163210932s) [noise=true , address=145.79.227.43:4182   , piece_id=73635ESLBZ56QJ6PR7RJVCPXXRHQ2NN7J7ESOTJ565VD7ENNQY7A, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.336001367 (127h55m14.163709768s) [noise=true , address=45.91.116.5:4323     , piece_id=MFVSRXGBEBMNJKICUZ6MLXG4XO7N3COJ4B3SIWN57A6OGNQBT6JQ, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.336497691 (127h55m14.164206091s) [noise=true , address=45.91.116.14:4199    , piece_id=HNDLON6UX7XBZWKSDH3MXHOQYLXWUM2S3VZCJGVSK62QDRPOX5JQ, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.336968405 (127h55m14.164676805s) [noise=true , address=45.91.116.4:4966     , piece_id=YAFE3LQFRPUSHBPJ4X6BBF3P5DXC2DNLNECULEIZE7UVP2D7UPXQ, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.337602334 (127h55m14.165310735s) [noise=true , address=77.90.31.13:4660     , piece_id=CCRAV6KR537VUDT6KC7KM2GGPZA3DRR5ZMJYPS6HUQKCZ7SF26LA, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.338156275 (127h55m14.165864678s) [noise=true , address=145.79.227.30:4767   , piece_id=O5AL7TMAFZYTEYUDZREAKGM5ZVQ7L3HB7ARQL3DVKU6IZBFGFJ3A, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.338693786 (127h55m14.166402187s) [noise=true , address=145.79.227.40:4068   , piece_id=OCC6IDZLTJQNEZN54LVCIVZOJNXYEDDBOUOVVXS2X4WD6BIHXSLA, seg_pos={0 0}, upload=133034]: Uploading piece...
Dec 10 23:23:13.402816786 (127h55m14.230525181s) [upload=133034]: Next returned nil segment
Dec 10 23:23:13.402834683 (127h55m14.230543084s) [upload=133034]: Waiting for error group managing segments...
Dec 10 23:23:13.411344304 (127h55m14.239052684s) [noise=true , address=145.79.227.40:4068   , piece_id=OCC6IDZLTJQNEZN54LVCIVZOJNXYEDDBOUOVVXS2X4WD6BIHXSLA, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:13.411833639 (127h55m14.239542019s) [noise=true , address=145.79.227.43:4182   , piece_id=73635ESLBZ56QJ6PR7RJVCPXXRHQ2NN7J7ESOTJ565VD7ENNQY7A, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:13.411873118 (127h55m14.239581501s) [noise=true , address=145.79.227.23:4577   , piece_id=UZTYJEQMSC3AVGSM7TNWNA5X34E37KQQAL2QRWM22MXCEH2WSJWQ, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:13.422615418 (127h55m14.250323799s) [noise=true , address=45.91.116.5:4323     , piece_id=MFVSRXGBEBMNJKICUZ6MLXG4XO7N3COJ4B3SIWN57A6OGNQBT6JQ, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:13.423817396 (127h55m14.251525788s) [noise=true , address=45.91.116.14:4199    , piece_id=HNDLON6UX7XBZWKSDH3MXHOQYLXWUM2S3VZCJGVSK62QDRPOX5JQ, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:13.424231288 (127h55m14.251939679s) [noise=true , address=45.91.116.9:4285     , piece_id=3WW4U24AAJ44VBV4Z72MU3CJQLTNCNMRLOQF35AOSD4LUT3G5TDQ, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:13.425362243 (127h55m14.253070625s) [noise=true , address=45.91.116.4:4966     , piece_id=YAFE3LQFRPUSHBPJ4X6BBF3P5DXC2DNLNECULEIZE7UVP2D7UPXQ, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:13.492597335 (127h55m14.320305719s) [noise=true , address=5.231.73.4:4019      , piece_id=E6TH36ECK4CLI6XIGSTCHRR43C2JJ2F5TPGHT4LNVLAXCB43ZQPQ, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:13.953415593 (127h55m14.781123973s) [noise=true , address=64.49.13.139:4473    , piece_id=LN4JYLHZVFBCLLUDGP3O5OWSHUUZNGYGGXAEHBZYAOWGN2NJFMRQ, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:14.399805480 (127h55m15.22751386s) [noise=true , address=145.79.227.16:4915   , piece_id=A7LAA5PWTCXWHN623JJY4TUPQEOWT6ATPOFOAZHX4EGJZANAC2FQ, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:23:14.495342220 (127h55m15.323050613s) [noise=true , address=145.79.227.30:4767   , piece_id=O5AL7TMAFZYTEYUDZREAKGM5ZVQ7L3HB7ARQL3DVKU6IZBFGFJ3A, seg_pos={0 0}, upload=133034]: Done uploading piece. err: <nil>
Dec 10 23:24:13.269114581 (127h56m14.096822981s) [noise=true , address=77.90.31.14:4685     , piece_id=OTJT52ZNJNFM47EXFY7ULSZBWRU6UITPFFSSX6SU2D6PFBBYATOA, seg_pos={0 0}, upload=133034]: Done uploading piece. err: ecclient: upload failed (node:12N4QaMcFs6FM8rCLDLYoqiYJDge5tGMwUZkoJc41YA2NM4RAKG, address:77.90.31.14:4685): protocol: rpc: dial tcp 77.90.31.14:4685: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:24:13.269139390 (127h56m14.096847792s) [noise=true , address=77.90.31.12:4619     , piece_id=HCFOJ54U3CP636I6MV7I5UHSZDUYTU323DBDNLAITEDMMGWOFXAA, seg_pos={0 0}, upload=133034]: Done uploading piece. err: ecclient: upload failed (node:12Y3X8z9oBzPFDeM4psz1KBtFTcJQS4STc4xiL2N2V8sCEcDDKX, address:77.90.31.12:4619): protocol: rpc: dial tcp 77.90.31.12:4619: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:24:13.269446863 (127h56m14.097155265s) [noise=true , address=77.90.31.17:4794     , piece_id=S5R766MWUEKFYLZUU24U5UUFWGV2JB22THYCKD6CYNYHGNRYWOCQ, seg_pos={0 0}, upload=133034]: Done uploading piece. err: ecclient: upload failed (node:1uouoLKpbu62sxnPGb5c5U8Y8z4tAYBTzLFFHdA51VLrFSZc63, address:77.90.31.17:4794): protocol: rpc: dial tcp 77.90.31.17:4794: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:24:13.269617860 (127h56m14.097326261s) [noise=true , address=77.90.31.16:4759     , piece_id=FAPWSWNXEBWDR3HQ2UC4IJWLJXWXTXMAL45PBJXK5WC2DWFMUMLA, seg_pos={0 0}, upload=133034]: Done uploading piece. err: ecclient: upload failed (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE, address:77.90.31.16:4759): protocol: write tcp 159.223.143.39:46254->77.90.31.16:4759: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:24:13.269886046 (127h56m14.097594439s) [noise=true , address=77.90.31.18:4817     , piece_id=I7D2QBX2DIWWL7GIOBQL53UIH2CSYGAP736SUO44NINR7QXK346A, seg_pos={0 0}, upload=133034]: Done uploading piece. err: ecclient: upload failed (node:12Qv5LBuANP9vS2vbsVNrJ7Mkc3SqXwTNCBzLvN955RHFKQVv5x, address:77.90.31.18:4817): protocol: write tcp 159.223.143.39:43296->77.90.31.18:4817: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:24:13.269930712 (127h56m14.097639111s) [noise=true , address=77.90.31.13:4657     , piece_id=4S2S2BWBDRDRLBSGPMYSPFPGQ7RPYUOPDPIRGDEJC7W5KQL5UPRA, seg_pos={0 0}, upload=133034]: Done uploading piece. err: ecclient: upload failed (node:1LLSnWuMa6W7y2jhFUqXoSPEsTyrFsKi8FQDNXF8Tv7XHbP6yt, address:77.90.31.13:4657): protocol: rpc: dial tcp 77.90.31.13:4657: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:24:13.270079558 (127h56m14.097787942s) [noise=true , address=77.90.31.13:4660     , piece_id=CCRAV6KR537VUDT6KC7KM2GGPZA3DRR5ZMJYPS6HUQKCZ7SF26LA, seg_pos={0 0}, upload=133034]: Done uploading piece. err: ecclient: upload failed (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG, address:77.90.31.13:4660): protocol: rpc: dial tcp 77.90.31.13:4660: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:24:13.270107259 (127h56m14.097815639s) [seg_pos={0 0}, upload=133034]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil>
Dec 10 23:24:13.296627273 (127h56m14.124335663s) [upload=133034]: Done uploading segments...
Dec 10 23:24:13.296674323 (127h56m14.124382717s) [upload=133034]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11)
Duration: 8.035353427s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [........................................................XXX.]
duration: 
520.194105ms
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:25:24 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 520.215344ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration: 
1m0.00076176s
trace: 
https://jaeger.dev.storj.io/trace/3e967eec712b2e24
FAIL (2025-12-10 23:25:23 UTC) 
operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000777188s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration: 
1m0.028294661s
trace: 
https://jaeger.dev.storj.io/trace/24e6dd585c55c852
FAIL (2025-12-10 23:25:10 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 12)
======LOGS======
46094290 (127h56m11.673802681s) [upload=133049]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 10 23:24:10.875675013 (127h56m11.703383414s) [seg_pos={0 0}, upload=133049]: Begin upload segment...
Dec 10 23:24:10.875763420 (127h56m11.703471812s) [seg_pos={0 0}, upload=133049]: Done begin upload segment.
Dec 10 23:24:10.875830354 (127h56m11.703538767s) [noise=true , address=77.90.31.10:4524     , piece_id=4FXZIATXUDCIDRZKDPJ4UL7XRJ7ORQ3VGIAKZCKICFK64QZQCCMQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.879366809 (127h56m11.707075202s) [noise=true , address=64.49.13.139:4472    , piece_id=WYVBK2FAELPEXMA6JEJI2IVM7TROGRE53V5HA5RWBGT5I3JYFMSQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.880029801 (127h56m11.707738203s) [noise=true , address=145.79.227.33:4873   , piece_id=LTX75GTXAD7AC6MN32XBRVZH6JFAXVBLO5EZJTQBDF6ZRHGCNUTQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.880724783 (127h56m11.708433182s) [noise=true , address=77.90.31.13:4656     , piece_id=5K34DFJZQOEZLB23VECWR6M54BDFC4G2ERZ5S7HOYLVAFP24Q23A, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.881299345 (127h56m11.709007745s) [noise=true , address=77.90.31.19:4846     , piece_id=P7LFR73SJ5YRDZZGX2EEH5HZCROQQ6BBAGIF6GHHDAXBPB54GM5Q, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.881824503 (127h56m11.709532905s) [noise=true , address=145.79.227.28:4755   , piece_id=FOGIE3UTQJUZG3XJ3T7UDRIJO6TEOFQRQN57CZ264T2UOIDNYPZQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.882285734 (127h56m11.709994125s) [noise=true , address=45.91.116.6:4007     , piece_id=UZBVEETNQO62ETWOYFSGMPZ5W6ZVGMTWMDEZ7A5IRWJVZWKVGLZQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.883748403 (127h56m11.711456797s) [noise=true , address=45.91.116.12:4243    , piece_id=HIXJH7NUOD3XBB7EVQELJWUJQSQZ5KUHBJKACDHI6MSRUOVHI6RQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.883796682 (127h56m11.711505078s) [noise=true , address=145.79.227.30:4784   , piece_id=XNRWTYS32JMZE6WQSFB3HFQUMK6BEZKTU53WTTMPE3FZDANR5TQA, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.885266404 (127h56m11.712974805s) [noise=true , address=45.91.116.9:4289     , piece_id=BLSSYDZDND2KJU3TTSUWHZ7CA2M7OWBYVGZG6MK4OADDZHSS7J3A, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.885667735 (127h56m11.713376132s) [noise=true , address=77.90.31.15:4716     , piece_id=JUYMPEW5BXDOJ5H6KX6TGOT3LNVLXZ6G2PQ2EURZ7AE3PIIR7VIQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.886780413 (127h56m11.714488807s) [noise=true , address=145.79.227.49:4345   , piece_id=EEZBRVUWVMJJEW2DGFDEECU6DXTB2DBBZZGIV32HHUWR2WGS7XRQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.887410985 (127h56m11.715119366s) [noise=true , address=145.79.227.29:4961   , piece_id=VXZEZTRKATUVKOYCXJIJRC74DQR56JWQV3EWW5T323N3XFJ577BQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.889274150 (127h56m11.716982554s) [noise=true , address=77.90.31.11:4584     , piece_id=GDZLYABUAJLYYAFKAJN4CIU6SYVGHM5PIFFZPYOHTD52SUAC37ZQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.892234681 (127h56m11.71994309s) [noise=true , address=145.79.227.45:4238   , piece_id=7XU3ADBSG6ATTLCJ63TJYJ7PK2BHLXKO4HBDOFKLSACBHODJ4WGQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.892330688 (127h56m11.720039089s) [noise=true , address=45.91.116.5:4303     , piece_id=C43RMMKOZBE3BUKSWTZ4UOXCXS4MZPLTCBTGHT7VGEH2ICO4RLQA, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.894973863 (127h56m11.722682257s) [noise=true , address=77.90.31.17:4795     , piece_id=SSSX7REU636TTONWYXMFRSFPLDHRJLOJJEZRX2HNIL3O653J4OYA, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.897607357 (127h56m11.725315752s) [noise=true , address=145.79.227.32:4855   , piece_id=HCBUIQVYTL37II32HYPWFYIM3MHXA6LDCC6MF6DM6D2PV3CFMBWQ, seg_pos={0 0}, upload=133049]: Uploading piece...
Dec 10 23:24:10.946781133 (127h56m11.774489516s) [upload=133049]: Next returned nil segment
Dec 10 23:24:10.947002346 (127h56m11.77471076s) [upload=133049]: Waiting for error group managing segments...
Dec 10 23:24:10.950377074 (127h56m11.778085465s) [noise=true , address=45.91.116.6:4007     , piece_id=UZBVEETNQO62ETWOYFSGMPZ5W6ZVGMTWMDEZ7A5IRWJVZWKVGLZQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:10.950859737 (127h56m11.778568129s) [noise=true , address=45.91.116.12:4243    , piece_id=HIXJH7NUOD3XBB7EVQELJWUJQSQZ5KUHBJKACDHI6MSRUOVHI6RQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:10.952166700 (127h56m11.779875092s) [noise=true , address=45.91.116.9:4289     , piece_id=BLSSYDZDND2KJU3TTSUWHZ7CA2M7OWBYVGZG6MK4OADDZHSS7J3A, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:10.953116465 (127h56m11.780824858s) [noise=true , address=145.79.227.49:4345   , piece_id=EEZBRVUWVMJJEW2DGFDEECU6DXTB2DBBZZGIV32HHUWR2WGS7XRQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:10.953358508 (127h56m11.781070207s) [noise=true , address=145.79.227.45:4238   , piece_id=7XU3ADBSG6ATTLCJ63TJYJ7PK2BHLXKO4HBDOFKLSACBHODJ4WGQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:10.956572820 (127h56m11.784281212s) [noise=true , address=145.79.227.33:4873   , piece_id=LTX75GTXAD7AC6MN32XBRVZH6JFAXVBLO5EZJTQBDF6ZRHGCNUTQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:10.958640457 (127h56m11.786348848s) [noise=true , address=145.79.227.32:4855   , piece_id=HCBUIQVYTL37II32HYPWFYIM3MHXA6LDCC6MF6DM6D2PV3CFMBWQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:10.967633582 (127h56m11.795341974s) [noise=true , address=145.79.227.28:4755   , piece_id=FOGIE3UTQJUZG3XJ3T7UDRIJO6TEOFQRQN57CZ264T2UOIDNYPZQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:10.985189620 (127h56m11.812898011s) [noise=true , address=145.79.227.29:4961   , piece_id=VXZEZTRKATUVKOYCXJIJRC74DQR56JWQV3EWW5T323N3XFJ577BQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:10.998731588 (127h56m11.826439982s) [noise=true , address=45.91.116.5:4303     , piece_id=C43RMMKOZBE3BUKSWTZ4UOXCXS4MZPLTCBTGHT7VGEH2ICO4RLQA, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:11.509442081 (127h56m12.337150472s) [noise=true , address=64.49.13.139:4472    , piece_id=WYVBK2FAELPEXMA6JEJI2IVM7TROGRE53V5HA5RWBGT5I3JYFMSQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:24:11.942910933 (127h56m12.770619325s) [noise=true , address=145.79.227.30:4784   , piece_id=XNRWTYS32JMZE6WQSFB3HFQUMK6BEZKTU53WTTMPE3FZDANR5TQA, seg_pos={0 0}, upload=133049]: Done uploading piece. err: <nil>
Dec 10 23:25:10.814955598 (127h57m11.642663991s) [noise=true , address=77.90.31.11:4584     , piece_id=GDZLYABUAJLYYAFKAJN4CIU6SYVGHM5PIFFZPYOHTD52SUAC37ZQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: ecclient: upload failed (node:1iybcvQgVfqHcCSNFAEVpKZJyciSHbBfeAiuk3uNE2LGq4aLfJ, address:77.90.31.11:4584): protocol: rpc: dial tcp 77.90.31.11:4584: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:25:10.815101201 (127h57m11.642809582s) [noise=true , address=77.90.31.19:4846     , piece_id=P7LFR73SJ5YRDZZGX2EEH5HZCROQQ6BBAGIF6GHHDAXBPB54GM5Q, seg_pos={0 0}, upload=133049]: Done uploading piece. err: ecclient: upload failed (node:12V76dqXhBHet772yUXG9oRU9r1m7rtXQeARRVzTeGrcJxxzyvM, address:77.90.31.19:4846): protocol: write tcp 159.223.143.39:59180->77.90.31.19:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:25:10.815229212 (127h57m11.642937606s) [noise=true , address=77.90.31.17:4795     , piece_id=SSSX7REU636TTONWYXMFRSFPLDHRJLOJJEZRX2HNIL3O653J4OYA, seg_pos={0 0}, upload=133049]: Done uploading piece. err: ecclient: upload failed (node:1mxsUnqqgD1WuDixAq7bcMiQb6JzmC4seq8s2YXY7HjvgKCkGt, address:77.90.31.17:4795): protocol: write tcp 159.223.143.39:51516->77.90.31.17:4795: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:25:10.815344910 (127h57m11.643053304s) [noise=true , address=77.90.31.13:4656     , piece_id=5K34DFJZQOEZLB23VECWR6M54BDFC4G2ERZ5S7HOYLVAFP24Q23A, seg_pos={0 0}, upload=133049]: Done uploading piece. err: ecclient: upload failed (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN, address:77.90.31.13:4656): protocol: write tcp 159.223.143.39:33608->77.90.31.13:4656: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:25:10.815452267 (127h57m11.643160661s) [noise=true , address=77.90.31.10:4524     , piece_id=4FXZIATXUDCIDRZKDPJ4UL7XRJ7ORQ3VGIAKZCKICFK64QZQCCMQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: ecclient: upload failed (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe, address:77.90.31.10:4524): protocol: rpc: dial tcp 77.90.31.10:4524: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 10 23:25:10.815962853 (127h57m11.643671253s) [noise=true , address=77.90.31.15:4716     , piece_id=JUYMPEW5BXDOJ5H6KX6TGOT3LNVLXZ6G2PQ2EURZ7AE3PIIR7VIQ, seg_pos={0 0}, upload=133049]: Done uploading piece. err: ecclient: upload failed (node:12tuEGhEzrpo1eV7v2QatHXHMy7b1S5gcVSymWYWJSoCFUMGnaL, address:77.90.31.15:4716): protocol: context deadline exceeded; context deadline exceeded
Dec 10 23:25:10.815995641 (127h57m11.643704026s) [seg_pos={0 0}, upload=133049]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil>
Dec 10 23:25:10.841141301 (127h57m11.668849695s) [upload=133049]: Done uploading segments...
Dec 10 23:25:10.841182277 (127h57m11.66889067s) [upload=133049]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12)
Duration: 1m0.028315898s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
3 out of 60 is failed (threshold=6) [........................................................XXX.]
duration: 
468.822234ms
trace: 
https://jaeger.dev.storj.io/trace/3922add3ad0b5b40
FAIL (2025-12-10 23:24:54 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 468.852184ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration: 
445.516422ms
trace: 
https://jaeger.dev.storj.io/trace/6e1f15cb7b3e3fe9
FAIL (2025-12-10 23:24:34 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 445.54599ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration: 
1m0.000742724s
trace: 
https://jaeger.dev.storj.io/trace/1e851cc00ec5bd3
FAIL (2025-12-10 23:24:23 UTC) 
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000836612s core uplink us-select-1 us1-placement-20