Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 412.835227ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:45:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 412.863891ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 391.454772ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:44:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 391.48318ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 395.998835ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:43:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 396.027537ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 374.152711ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:42:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 374.179101ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 425.409454ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:42:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 425.447501ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 412.023042ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:41:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 412.049373ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 402.132218ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:41:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 402.174909ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 430.860418ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:40:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 430.900928ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 390.264171ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:39:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 390.285257ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 445.189201ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:38:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 445.216609ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 524.091776ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:37:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 524.134429ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 460.291504ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:36:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 460.345268ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 364.809871ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:35:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 364.834642ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 435.615696ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:34:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 435.644127ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 490.28609ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:33:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 490.311699ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 387.988724ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:33:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 388.016315ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 462.821671ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:32:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 462.858111ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 463.595481ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:32:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 463.624938ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 486.96353ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:31:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 486.994179ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 269.498823ms trace: https://jaeger.dev.storj.io/trace/15d9699ef5856439 FAIL (2026-03-10 03:30:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context canceled ======LOGS====== Mar 10 03:30:26.400470515 (88h30m23.99724153s) [upload=99029]: Starting upload Mar 10 03:30:26.400549920 (88h30m23.997320949s) [upload=99029]: Done starting upload Mar 10 03:30:26.400723479 (88h30m23.997494492s) [upload=99029]: Uploading segments... Mar 10 03:30:26.400916202 (88h30m23.99768723s) [upload=99029]: Got next segment. Inline: false Mar 10 03:30:26.401010555 (88h30m23.997781583s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Mar 10 03:30:26.401018253 (88h30m23.997789279s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentBegin Mar 10 03:30:26.430477746 (88h30m24.027248772s) [seg_pos={0 0}, upload=99029]: Begin upload segment... Mar 10 03:30:26.430560181 (88h30m24.027331193s) [seg_pos={0 0}, upload=99029]: Done begin upload segment. Mar 10 03:30:26.430594758 (88h30m24.027365792s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.430627619 (88h30m24.027398651s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.431330226 (88h30m24.02810125s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432084089 (88h30m24.028855104s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432773019 (88h30m24.029544035s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.432917989 (88h30m24.02968902s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.434283438 (88h30m24.031054471s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.436329199 (88h30m24.033100222s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.443120493 (88h30m24.039891522s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.445208438 (88h30m24.041979471s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.448571281 (88h30m24.045342309s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450175052 (88h30m24.046946085s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450435387 (88h30m24.047206416s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.450749876 (88h30m24.04752089s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.451942610 (88h30m24.048713638s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.457706199 (88h30m24.054477232s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Uploading piece... Mar 10 03:30:26.537289064 (88h30m24.134060074s) [upload=99029]: Next returned nil segment Mar 10 03:30:26.537309578 (88h30m24.134080613s) [upload=99029]: Waiting for error group managing segments... Mar 10 03:30:26.543428198 (88h30m24.140199222s) [noise=true , address=45.91.116.9:4295 , piece_id=7KBW3P7HDBHB4MAQ3W3DH2STVAAST3KFVT47H6TN4FEKDZ6CHE6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.543509654 (88h30m24.140280688s) [noise=true , address=45.91.116.11:4121 , piece_id=QAZKSEQMVNWJEZFD23GKR754K5A7BEAHBLNZWJ7Y6LGV57U5SARA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.545528352 (88h30m24.142299363s) [noise=true , address=145.79.227.19:4082 , piece_id=GW3627XI3IW2UDAY2CDLEZUSKR5TB75LPYMJD3QEGU6AMIB5OWPA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.546079396 (88h30m24.142850422s) [noise=true , address=145.79.227.47:4265 , piece_id=A5AU3QAJY2SB6SHRHQKJ6NZZ3VE3472JSU3NQAZRK7YD5PNMW5JQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547067551 (88h30m24.143838563s) [noise=true , address=145.79.227.15:4873 , piece_id=OB7T2XEXSNVHXRN2GKS7FH2OB3XBR3XAZBORMMNJOHQPZ3XQQHKA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.547475238 (88h30m24.144246251s) [noise=true , address=79.127.219.41:4928 , piece_id=LAYU66NEWQNMDNMSI5UDJKC43SPAGLD2WGOILURPOLBFLGHIBMDA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.548670515 (88h30m24.14544153s) [noise=true , address=145.79.227.38:4980 , piece_id=BKU6KJJAQJEXGOMCHILD5QFYZQVCR62ZWXIAFIZTQNUPSAK42PZA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.549072511 (88h30m24.145843524s) [noise=true , address=145.79.227.18:4011 , piece_id=X7DJEF5HXNOXGE3ESESXFJXFIGDFGX4YJLHWM2E3U6T3XATHQJ7A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555074806 (88h30m24.151845822s) [noise=true , address=145.79.227.40:4052 , piece_id=NEQXES4FHKDBSDM54YVOEN4BDKITGSATSNU3OTUMODTJIPCCFHGA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555202619 (88h30m24.151973632s) [noise=true , address=145.79.227.8:4332 , piece_id=HFWYYBL54ELK3JCDVOTFD3E4YKXUPYJ6TELZFLYGZIY6KMIP4S6A, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.555891112 (88h30m24.152662122s) [noise=true , address=145.79.227.3:4153 , piece_id=QGHPYR3BBFESMADBC4YTROTTJSDFHDDBK3XPK2NSKFMRXTZSJDEA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.556216023 (88h30m24.152987036s) [noise=true , address=145.79.227.33:4875 , piece_id=DCZIABX6B3KSZVVWHXQMJQ76ILIMWDUU3UHWFI2M4XR2HE3ACA3Q, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560025999 (88h30m24.156797026s) [noise=true , address=145.79.227.39:4017 , piece_id=OSBLSGKAPIISJJBO7ET3P65Y3Z2RFNR3BLZCHZVXFHOHEO3OEDJA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: <nil> Mar 10 03:30:26.560054868 (88h30m24.156825905s) [seg_pos={0 0}, upload=99029]: Satisfied cohort requirements after 13 pieces Mar 10 03:30:26.560366952 (88h30m24.157137987s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121fzX9v4rgEd78xnDAwcQtthyQHV3yUZUQYLXZ9byPDucGK4T5): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560380635 (88h30m24.157151672s) [noise=true , address=145.79.227.50:4375 , piece_id=J2D5BZZMHU6BEQI3OQWWN6CCKAC4WVPLAIXR5U77C6QXSRHMFKYQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560411581 (88h30m24.157182632s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122nFQhbiCN9A3p3qQFsWKwXFFcmtWRXDLBAP57rcLcQBVhShHB): protocol: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:34400->145.79.227.48:4305: use of closed network connection Mar 10 03:30:26.560424741 (88h30m24.157195767s) [noise=true , address=145.79.227.48:4305 , piece_id=UU37UIOZJJPIURNP5I4MP6NUL43U42ULQ2GXLDX6N53XHZCUI5WQ, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560869502 (88h30m24.157640525s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2pJxnoFW2TAzcAzNhjzDRJ3yYDK2mibG8tdX2Qy2YabNTq86): protocol: expected piece hash; context canceled; EOF Mar 10 03:30:26.560886191 (88h30m24.157657204s) [noise=true , address=145.79.227.7:4297 , piece_id=QOAMRDHQLI62XVZQF2OH4SF2WZX2OZPULWSIRV5OEIYSARTVG3YA, seg_pos={0 0}, upload=99029]: Long tail cancellation due to optimal threshold Mar 10 03:30:26.560939806 (88h30m24.157710883s) [seg_pos={0 0}, upload=99029]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Mar 10 03:30:26.561043132 (88h30m24.157814155s) [upload=99029]: Flush batch item: pb.BatchRequestItem_SegmentCommit Mar 10 03:30:26.561049781 (88h30m24.157820812s) [upload=99029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Mar 10 03:30:26.608097299 (88h30m24.20486833s) [upload=99029]: Done uploading segments... Mar 10 03:30:26.608117724 (88h30m24.204888753s) [upload=99029]: Upload finished. err: <nil> Duration: 269.526367ms core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.527476811s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:21:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.52750057s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.5054996s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:20:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.505525313s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.093175976s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:19:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.093197308s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.51993344s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:19:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.519959742s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.515312145s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:18:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.51533496s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.533715328s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:18:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.533753208s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.50168781s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:17:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.501711352s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.138009297s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:17:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.138036184s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.150338517s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:16:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.15036985s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.101830617s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:15:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.101857488s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.706777323s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:14:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.706799892s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.129425435s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:13:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.129442061s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.405500479s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:12:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.405528848s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.139522537s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:12:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.13956126s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.480185972s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:11:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.480212523s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.075724163s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:11:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.075747015s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.160886123s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:10:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.160913461s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.55620196s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:10:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.55622986s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.464038347s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:09:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.46405491s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.088296664s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:09:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.088419905s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.145639227s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:08:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.14566554s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.44748546s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:07:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.447511795s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.066428214s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:07:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.066449411s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.46460747s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:06:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.464634576s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.150037584s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:05:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.150064431s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.516167523s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:04:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.516195574s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.153359984s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:03:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.153388603s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.193830957s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:02:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.193855751s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.469177601s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:02:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.469204214s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.194521783s trace: https://jaeger.dev.storj.io/trace/3d55edd4b63f9318 FAIL (2026-03-08 10:01:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== ce_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161052658 (46h37m47.757823691s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161559801 (46h37m47.758330837s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.161819273 (46h37m47.758590309s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162285820 (46h37m47.759056849s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162680481 (46h37m47.759451508s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.162874301 (46h37m47.759645337s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.163372239 (46h37m47.760143274s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Uploading piece... Mar 8 09:37:50.591451519 (46h37m48.188222535s) [upload=52151]: Next returned nil segment Mar 8 09:37:50.591499885 (46h37m48.188270917s) [upload=52151]: Waiting for error group managing segments... Mar 8 09:37:50.762229902 (46h37m48.359000915s) [noise=true , address=81.171.14.70:4030 , piece_id=IIHKVI5T4EVIDKTDPXZIHMCA73E7Z7G5UBAUUBOR6HJ7BF7R7FRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.762919188 (46h37m48.35969021s) [noise=true , address=81.171.14.70:4043 , piece_id=QPZC2F74ZVNN5GMSLAWMOSQYOGDT63DY6H4MOW7LQJBHYY4SOYTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.765848186 (46h37m48.362619216s) [noise=true , address=81.171.14.70:4045 , piece_id=3XPR6ZXEP6IFWXNWC4ST63AWHK4RK2YAC35PULAWGUPDKRQL2KWQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771222053 (46h37m48.367993081s) [noise=true , address=81.171.14.70:4033 , piece_id=CIA6AUWWAY6JOMTX5SFVBE22XYGZO3ZL3GBEQLFUOSENRSPYYN6Q, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:50.771608359 (46h37m48.368379372s) [noise=true , address=81.171.14.70:4037 , piece_id=QTZN37WURGPH4VAX2TGPLAWLHTMGGY4NFKCOPM3ZGSYS4B5HXIYA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:51.256945370 (46h37m48.853716383s) [noise=true , address=81.171.14.70:4047 , piece_id=KTHM3C5TPASJNGUUQH2DPHIBB532K7BTY4MF7TKIFXZBL4LD6CDQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:52.289499748 (46h37m49.886270774s) [noise=true , address=185.167.204.206:4054 , piece_id=6AHXFF3574BTR5QULVECV3FPAHCXNTIIO67R52FGJABB3JRSQGLA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:53.449423657 (46h37m51.046194682s) [noise=true , address=185.167.204.205:4006 , piece_id=RNRZ7N733AXZYX63ER2SRXNTACZYE6O5EVZEWYBSPWVQMGLFJKJQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:55.628149424 (46h37m53.224920457s) [noise=true , address=185.167.204.205:4027 , piece_id=U4W37MIONI2X3M74Q6JF5SMACHO7MJPSVYX6LT4HVOCK262M7WYQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:57.892033761 (46h37m55.488804787s) [noise=true , address=185.167.204.205:4017 , piece_id=SJ7LYEUQLAR372CFO6Z2CNZXK3IBVSOLA25UGY6GWYTKMX6A7QHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.556972337 (46h37m56.153743364s) [noise=true , address=185.167.204.205:4014 , piece_id=EQUY3SWZWPPE65TOZYIPXM2MHMGVEBHKR5ZGVIPQFTWJ6WMNQXAQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.809090895 (46h37m56.405861923s) [noise=true , address=185.167.204.206:4063 , piece_id=P2AGADHXIK3DECTOBCXEBJADXOAOIX5PAM6PVY53BKKB3TNIPMRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.935138669 (46h37m56.531909699s) [noise=true , address=185.167.204.206:4053 , piece_id=XKTJCU474UQJXDDYWUNLPQUNMUXGEP3YUURQCKNRVKH7A47NYNRQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:58.998991071 (46h37m56.595762084s) [noise=true , address=185.167.204.205:4025 , piece_id=F2DY2JHSWPYSC7FN7WT6UAMFMXIVZU4UJB5SLUV5T3J5R5BDOGTA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:37:59.906533676 (46h37m57.5033047s) [noise=true , address=89.149.201.147:4009 , piece_id=YBFNYUW7KK2QERRZ5Z4KHWCH7I5RKUINZWTGESTISKTZ44UQ2LFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.830964251 (46h37m58.427735277s) [noise=true , address=185.167.204.206:4064 , piece_id=AJ46W25IUJIVYCDVPCFWMJQAO4UXDYW5QEE424TLCMI45USC3GUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:00.866622867 (46h37m58.463393895s) [noise=true , address=185.167.204.206:4057 , piece_id=M7WRHRBJ6EEH7SPAVPZME3RAV2ILUT4ZVA5BDWXNYBENKQUOA22A, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:10.109853972 (46h38m7.706624987s) [noise=true , address=185.167.204.206:4049 , piece_id=YBAYWAMTDTB3PVBO64P6VQRNSJSFC2TS7YAN6QMHYFWWXMRXFDFA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.276274459 (46h38m42.873045489s) [noise=true , address=185.167.204.205:4012 , piece_id=MXGR43IUF2654CGZAVS2IIY3VW57C7FMEVOHEF3MVC3WIODBQNMA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.286137678 (46h38m42.882908695s) [noise=true , address=185.167.204.205:4007 , piece_id=CM63KTEG23OOSW4YBZDQZEQM64AURKQYOPIUVGBOYZUUJIWS62TQ, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:45.788371259 (46h38m43.38514229s) [noise=true , address=89.149.201.147:4017 , piece_id=JYK44H46UJMPQ4KNVK5PRCGYHVXK4JUART6NHXYMLX2ZB4ZWS2GA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:47.180647438 (46h38m44.777418466s) [noise=true , address=185.167.204.205:4033 , piece_id=NQSER2BHZOGWWVWPOLSGOD2YRFOSTZCK244PFHQEQHEQUBBMSRUA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: <nil> Mar 8 09:38:49.780022343 (46h38m47.376793377s) [noise=true , address=185.167.204.205:4002 , piece_id=UG5Z2CD72KZSBLZCFMBKKXIIMR4JBPLUHMJFYZHQ6WTWDGCIAFOA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:55540->185.167.204.205:4002: use of closed network connection Mar 8 09:38:49.780133967 (46h38m47.376905019s) [noise=true , address=185.167.204.205:4016 , piece_id=DHQXRVZQOFQGKOBPEGQAWF64IIIFKIOLYI7PCLQKUHR7R2BSSGRA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1scSMv7XDKsGKUMR8t1AdrQubP2142yorfVKaE4UyQoufi34TJ, address:185.167.204.205:4016): protocol: read tcp 159.223.143.39:42154->185.167.204.205:4016: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780524263 (46h38m47.377295286s) [noise=true , address=185.167.204.205:4026 , piece_id=SSJYWAM7I2I3TD2LUJULWWJ25WJQVJXGR7SZYK5HQ5KZFJ6OWDAA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:1A9VrfmePrZ6AiT4SgVgEEahfBc5u5e2LnQm86gEpEkQgqB2e4, address:185.167.204.205:4026): protocol: read tcp 159.223.143.39:35038->185.167.204.205:4026: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780722723 (46h38m47.377493757s) [noise=true , address=185.167.204.205:4001 , piece_id=A4LBTBPZ57SQN35SHSG4UYRAJWLLWDTQMUOPQ67RGGQZG6EHZZHA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12gZXkE3Cnmu2oyKMmUfaADZ4LDPQahTcE9sUwW173on719Bb91, address:185.167.204.205:4001): protocol: read tcp 159.223.143.39:39924->185.167.204.205:4001: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780744639 (46h38m47.377515667s) [noise=true , address=185.167.204.205:4023 , piece_id=WAQETLYC4BP4S2AA23P2H3ZMBDI5GBMJJI7VLOCZCSTL3AILE7ZA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: read tcp 159.223.143.39:54758->185.167.204.205:4023: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780943579 (46h38m47.377714608s) [noise=true , address=89.149.201.147:4019 , piece_id=4PN4RYD5DK3H3FENU3W2XJLEHEARSCGKKCEJ2XYKED32FDP3K5QA, seg_pos={0 0}, upload=52151]: Done uploading piece. err: ecclient: upload failed (node:12wgZQR7Ezekmvf9cNwCZ8CmZBjZgoqWC3N2UE3n4YQSmBsqQQ2, address:89.149.201.147:4019): protocol: read tcp 159.223.143.39:58898->89.149.201.147:4019: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Mar 8 09:38:49.780994563 (46h38m47.377765592s) [seg_pos={0 0}, upload=52151]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Mar 8 09:38:49.883580760 (46h38m47.48035179s) [upload=52151]: Done uploading segments... Mar 8 09:38:49.883635264 (46h38m47.480406294s) [upload=52151]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.194554593s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)