Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..XXX.......................................................] duration: 416.362095ms FAIL (2025-07-08 05:43:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 416.395892ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...XXX......................................................] duration: 472.143898ms FAIL (2025-07-08 05:43:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 472.203818ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration: 451.670425ms FAIL (2025-07-08 05:42:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 451.724843ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration: 453.335687ms FAIL (2025-07-08 05:42:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 453.372892ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......XXX...................................................] duration: 444.421321ms FAIL (2025-07-08 05:41:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 444.788027ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 442.948007ms FAIL (2025-07-08 05:41:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 442.974166ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......XXX..................................................] duration: 452.619481ms FAIL (2025-07-08 05:40:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 452.651268ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 568.353506ms FAIL (2025-07-08 05:40:30 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 568.449839ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [XXX.........................................................] duration: 604.146288ms FAIL (2025-07-08 05:40:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 604.186327ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........XXX.................................................] duration: 515.136115ms FAIL (2025-07-08 05:39:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 515.204932ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [XXXX........................................................] duration: 428.893153ms FAIL (2025-07-08 05:39:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 428.919715ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.XXXX.......................................................] duration: 453.41686ms FAIL (2025-07-08 05:39:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 453.449318ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........XXX................................................] duration: 456.427073ms FAIL (2025-07-08 05:38:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 456.462484ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........XXX...............................................] duration: 645.657094ms FAIL (2025-07-08 05:38:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 645.684693ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..XXXX......................................................] duration: 528.344406ms FAIL (2025-07-08 05:38:03 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 528.379126ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........XXX..............................................] duration: 455.996551ms FAIL (2025-07-08 05:37:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 456.052259ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...XXXX.....................................................] duration: 466.070599ms FAIL (2025-07-08 05:36:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 466.093959ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [............XXX.............................................] duration: 521.815221ms FAIL (2025-07-08 05:36:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 521.867517ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....XXXX....................................................] duration: 457.423075ms FAIL (2025-07-08 05:36:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 457.450658ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............XXX............................................] duration: 648.684933ms FAIL (2025-07-08 05:36:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 648.722818ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....XXXX...................................................] duration: 444.732968ms FAIL (2025-07-08 05:35:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 444.764387ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......XXXX..................................................] duration: 436.951771ms FAIL (2025-07-08 05:35:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 436.998591ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..............XXX...........................................] duration: 485.353343ms FAIL (2025-07-08 05:35:04 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 485.420151ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......XXXX.................................................] duration: 478.432454ms FAIL (2025-07-08 05:34:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 478.464243ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........XXXX................................................] duration: 493.46979ms FAIL (2025-07-08 05:34:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 493.501071ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...............XXX..........................................] duration: 611.422341ms FAIL (2025-07-08 05:33:51 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 611.466497ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........XXXX...............................................] duration: 463.712867ms FAIL (2025-07-08 05:33:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 463.741172ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [................XXX.........................................] duration: 471.904624ms FAIL (2025-07-08 05:33:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 471.939409ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........XXXX..............................................] duration: 390.508155ms FAIL (2025-07-08 05:32:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 390.531807ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........XXXX.............................................] duration: 498.054297ms FAIL (2025-07-08 05:32:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 498.114405ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.................XXX........................................] duration: 494.785836ms FAIL (2025-07-08 05:32:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 494.812741ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............XXXX............................................] duration: 410.980012ms FAIL (2025-07-08 05:31:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 411.042378ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..................XXX.......................................] duration: 448.442528ms FAIL (2025-07-08 05:31:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 448.464454ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............XXXX...........................................] duration: 544.434639ms FAIL (2025-07-08 05:30:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 544.512804ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............XXXX..........................................] duration: 582.693294ms FAIL (2025-07-08 05:30:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 582.720472ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...................XXX......................................] duration: 606.674142ms FAIL (2025-07-08 05:30:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 606.734614ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............XXXX.........................................] duration: 453.027438ms FAIL (2025-07-08 05:29:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 453.056903ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [....................XXX.....................................] duration: 766.218888ms FAIL (2025-07-08 05:29:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 766.304844ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....................XXX....................................] duration: 450.303895ms FAIL (2025-07-08 05:28:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 450.336112ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [................XXXX........................................] duration: 536.723739ms FAIL (2025-07-08 05:28:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 536.862668ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................XXX...................................] duration: 508.420184ms FAIL (2025-07-08 05:27:57 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 508.456421ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................XXXX.......................................] duration: 414.959021ms FAIL (2025-07-08 05:27:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 415.050174ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......................XXX..................................] duration: 469.116832ms FAIL (2025-07-08 05:27:18 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 469.162013ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..................XXXX......................................] duration: 438.673106ms FAIL (2025-07-08 05:27:09 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 438.703701ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........................XXX.................................] duration: 444.138925ms FAIL (2025-07-08 05:26:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 444.178371ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...................XXXX.....................................] duration: 471.423462ms FAIL (2025-07-08 05:26:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 471.481684ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................XXX................................] duration: 478.975282ms FAIL (2025-07-08 05:25:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 479.011881ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....................XXXX....................................] duration: 484.2661ms FAIL (2025-07-08 05:25:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 484.297953ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....................XXXX...................................] duration: 447.939421ms FAIL (2025-07-08 05:24:44 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece... Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments... Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil> Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments... Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 447.972429ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........................XXX...............................] duration: 558.111128ms FAIL (2025-07-08 05:24:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 8) ======LOGS====== pload=284991]: Uploading piece... Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece... Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments... Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil> Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil> Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments... Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8) Duration: 558.162776ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)