Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 573.534903ms FAIL (2025-08-08 01:20:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 573.567036ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 550.420573ms FAIL (2025-08-08 01:20:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 550.453796ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 438.355758ms FAIL (2025-08-08 01:19:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 438.447504ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 493.020296ms FAIL (2025-08-08 01:18:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 493.045778ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 497.405837ms FAIL (2025-08-08 01:17:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 497.438826ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 603.330533ms FAIL (2025-08-08 01:16:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 603.36995ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 572.485216ms FAIL (2025-08-08 01:15:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 572.512407ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 947.240493ms FAIL (2025-08-08 01:14:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 947.264542ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 443.913442ms FAIL (2025-08-08 01:14:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 444.001028ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 407.688554ms FAIL (2025-08-08 01:13:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 407.731153ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 541.461481ms FAIL (2025-08-08 01:12:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 541.499752ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 713.282716ms FAIL (2025-08-08 01:11:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 713.311396ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 528.662476ms FAIL (2025-08-08 01:10:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 528.697734ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 497.808676ms FAIL (2025-08-08 01:09:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 497.836672ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.....................................X.....................] duration: 885.672037ms FAIL (2025-08-08 01:09:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 885.700742ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.....................................X....................] duration: 588.019401ms FAIL (2025-08-08 01:08:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 588.334497ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.....................................X...................] duration: 477.238351ms FAIL (2025-08-08 01:07:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 477.266781ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.....................................X..................] duration: 661.155847ms FAIL (2025-08-08 01:07:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 661.208331ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X.....................................X.................] duration: 526.87062ms FAIL (2025-08-08 01:06:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 526.905605ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X.....................................X................] duration: 447.510084ms FAIL (2025-08-08 01:05:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 447.604637ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X.....................................X...............] duration: 887.32643ms FAIL (2025-08-08 01:05:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 887.358519ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X.....................................X..............] duration: 623.342941ms FAIL (2025-08-08 01:04:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 623.37127ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.....................................X.............] duration: 789.840649ms FAIL (2025-08-08 01:04:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 789.881299ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X.....................................X............] duration: 641.518451ms FAIL (2025-08-08 01:03:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 641.546195ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X.....................................X...........] duration: 1.03443082s FAIL (2025-08-08 01:02:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 1.034459184s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X.....................................X..........] duration: 546.991281ms FAIL (2025-08-08 01:01:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 547.055045ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X.....................................X.........] duration: 745.181589ms FAIL (2025-08-08 01:00:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 745.211064ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X.....................................X........] duration: 610.104028ms FAIL (2025-08-08 00:59:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 610.135855ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X.....................................X.......] duration: 614.285097ms FAIL (2025-08-08 00:59:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 614.311733ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X.....................................X......] duration: 538.457293ms FAIL (2025-08-08 00:58:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 538.486347ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X.....................................X.....] duration: 590.867124ms FAIL (2025-08-08 00:58:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 590.892013ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X.....................................X....] duration: 713.602484ms FAIL (2025-08-08 00:57:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 713.62374ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X.....................................X...] duration: 1.198135692s FAIL (2025-08-08 00:56:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 1.198179063s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X.....................................X..] duration: 737.692784ms FAIL (2025-08-08 00:55:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 737.717646ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X.....................................X.] duration: 774.240135ms FAIL (2025-08-08 00:55:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 774.269295ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 179.126524ms FAIL (2025-08-08 00:53:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== g segments... Aug 8 00:01:46.657245436 (14h22m21.172348015s) [upload=14780]: Upload finished. err: <nil> Aug 8 00:02:30.275266890 (14h23m4.790369467s) [upload=14795]: Starting upload Aug 8 00:02:30.275331708 (14h23m4.790434285s) [upload=14795]: Done starting upload Aug 8 00:02:30.275419113 (14h23m4.790521681s) [upload=14795]: Uploading segments... Aug 8 00:02:30.275464303 (14h23m4.790566902s) [upload=14795]: Got next segment. Inline: true Aug 8 00:02:30.275470409 (14h23m4.790572986s) [upload=14795]: Waiting for error group managing segments... Aug 8 00:02:30.275541468 (14h23m4.790644064s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:02:30.275548435 (14h23m4.790651025s) [upload=14795]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:02:30.275553112 (14h23m4.790655694s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:02:30.437129275 (14h23m4.952231852s) [upload=14795]: Done uploading segments... Aug 8 00:02:30.437147837 (14h23m4.952250404s) [upload=14795]: Upload finished. err: <nil> Aug 8 00:03:02.216029168 (14h23m36.731131753s) [upload=14801]: Starting upload Aug 8 00:03:02.216131444 (14h23m36.731234024s) [upload=14801]: Done starting upload Aug 8 00:03:02.216223262 (14h23m36.731325836s) [upload=14801]: Uploading segments... Aug 8 00:03:02.216305099 (14h23m36.731407689s) [upload=14801]: Got next segment. Inline: true Aug 8 00:03:02.216311582 (14h23m36.731414165s) [upload=14801]: Waiting for error group managing segments... Aug 8 00:03:02.216381029 (14h23m36.731483612s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:02.216386785 (14h23m36.731489374s) [upload=14801]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:02.216390618 (14h23m36.731493197s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:02.283802345 (14h23m36.798904923s) [upload=14801]: Done uploading segments... Aug 8 00:03:02.283823305 (14h23m36.798925889s) [upload=14801]: Upload finished. err: <nil> Aug 8 00:03:30.509760483 (14h24m5.024863047s) [upload=14812]: Starting upload Aug 8 00:03:30.509815323 (14h24m5.024917908s) [upload=14812]: Done starting upload Aug 8 00:03:30.509926692 (14h24m5.02502927s) [upload=14812]: Uploading segments... Aug 8 00:03:30.509996173 (14h24m5.025098754s) [upload=14812]: Got next segment. Inline: true Aug 8 00:03:30.510002796 (14h24m5.025105377s) [upload=14812]: Waiting for error group managing segments... Aug 8 00:03:30.510068440 (14h24m5.025171017s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:30.510074098 (14h24m5.025176685s) [upload=14812]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:30.510077690 (14h24m5.025180273s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:30.698239096 (14h24m5.213341663s) [upload=14812]: Done uploading segments... Aug 8 00:03:30.698256740 (14h24m5.213359308s) [upload=14812]: Upload finished. err: <nil> Aug 8 00:04:41.065788390 (14h25m15.580890975s) [upload=14831]: Starting upload Aug 8 00:04:41.065849488 (14h25m15.580952064s) [upload=14831]: Done starting upload Aug 8 00:04:41.065914279 (14h25m15.581016856s) [upload=14831]: Uploading segments... Aug 8 00:04:41.065955528 (14h25m15.581058114s) [upload=14831]: Got next segment. Inline: true Aug 8 00:04:41.065961233 (14h25m15.581063813s) [upload=14831]: Waiting for error group managing segments... Aug 8 00:04:41.066010814 (14h25m15.581113395s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:41.066015217 (14h25m15.581117797s) [upload=14831]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:41.066019044 (14h25m15.581121626s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:41.143560517 (14h25m15.658663093s) [upload=14831]: Done uploading segments... Aug 8 00:04:41.143578273 (14h25m15.658680839s) [upload=14831]: Upload finished. err: <nil> Aug 8 00:04:57.174663208 (14h25m31.689765785s) [upload=14836]: Starting upload Aug 8 00:04:57.174738504 (14h25m31.68984108s) [upload=14836]: Done starting upload Aug 8 00:04:57.174818503 (14h25m31.689921072s) [upload=14836]: Uploading segments... Aug 8 00:04:57.174883379 (14h25m31.689985957s) [upload=14836]: Got next segment. Inline: true Aug 8 00:04:57.174888780 (14h25m31.689991347s) [upload=14836]: Waiting for error group managing segments... Aug 8 00:04:57.174955675 (14h25m31.690058262s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:57.174962095 (14h25m31.69006468s) [upload=14836]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:57.174966595 (14h25m31.690069178s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:57.317214071 (14h25m31.832316638s) [upload=14836]: Done uploading segments... Aug 8 00:04:57.317241163 (14h25m31.832343733s) [upload=14836]: Upload finished. err: <nil> Aug 8 00:06:06.741579891 (14h26m41.256682461s) [upload=14855]: Starting upload Aug 8 00:06:06.741694208 (14h26m41.256796791s) [upload=14855]: Done starting upload Aug 8 00:06:06.741776231 (14h26m41.256878801s) [upload=14855]: Uploading segments... Aug 8 00:06:06.741863808 (14h26m41.256966377s) [upload=14855]: Got next segment. Inline: true Aug 8 00:06:06.741870254 (14h26m41.25697283s) [upload=14855]: Waiting for error group managing segments... Aug 8 00:06:06.741939630 (14h26m41.257042211s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:06.741944620 (14h26m41.257047201s) [upload=14855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:06.741950358 (14h26m41.257052937s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:07.276784579 (14h26m41.791887173s) [upload=14855]: Done uploading segments... Aug 8 00:06:07.276805845 (14h26m41.79190841s) [upload=14855]: Upload finished. err: <nil> Aug 8 00:06:43.194994307 (14h27m17.710096878s) [upload=14865]: Starting upload Aug 8 00:06:43.195063177 (14h27m17.710165753s) [upload=14865]: Done starting upload Aug 8 00:06:43.195131851 (14h27m17.710234419s) [upload=14865]: Uploading segments... Aug 8 00:06:43.195200076 (14h27m17.710302661s) [upload=14865]: Got next segment. Inline: true Aug 8 00:06:43.195205915 (14h27m17.710308491s) [upload=14865]: Waiting for error group managing segments... Aug 8 00:06:43.195271114 (14h27m17.710373692s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:43.195276311 (14h27m17.710378889s) [upload=14865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:43.195279806 (14h27m17.710382383s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:43.430698626 (14h27m17.945801203s) [upload=14865]: Done uploading segments... Aug 8 00:06:43.430715582 (14h27m17.945818158s) [upload=14865]: Upload finished. err: <nil> Aug 8 00:07:00.838748208 (14h27m35.353850791s) [upload=14870]: Starting upload Aug 8 00:07:00.838831814 (14h27m35.353934397s) [upload=14870]: Done starting upload Aug 8 00:07:00.838944876 (14h27m35.354047439s) [upload=14870]: Uploading segments... Aug 8 00:07:00.839014925 (14h27m35.354117501s) [upload=14870]: Got next segment. Inline: true Aug 8 00:07:00.839045878 (14h27m35.354148457s) [upload=14870]: Waiting for error group managing segments... Aug 8 00:07:00.839120971 (14h27m35.354223549s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:07:00.839126346 (14h27m35.354228923s) [upload=14870]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:07:00.839129942 (14h27m35.354232518s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:07:00.932912415 (14h27m35.448014989s) [upload=14870]: Done uploading segments... Aug 8 00:07:00.932927726 (14h27m35.448030289s) [upload=14870]: Upload finished. err: <nil> Aug 8 00:08:14.384482900 (14h28m48.899585476s) [upload=14888]: Starting upload Aug 8 00:08:14.384593866 (14h28m48.899696446s) [upload=14888]: Done starting upload Aug 8 00:08:14.384673686 (14h28m48.899776254s) [upload=14888]: Uploading segments... Aug 8 00:08:14.384718832 (14h28m48.899821412s) [upload=14888]: Got next segment. Inline: true Aug 8 00:08:14.384723835 (14h28m48.899826412s) [upload=14888]: Waiting for error group managing segments... Aug 8 00:08:14.384763544 (14h28m48.89986612s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:08:14.384768731 (14h28m48.899871307s) [upload=14888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:08:14.384771994 (14h28m48.89987457s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:08:14.710769235 (14h28m49.225871818s) [upload=14888]: Done uploading segments... Aug 8 00:08:14.710803190 (14h28m49.225905767s) [upload=14888]: Upload finished. err: <nil> Aug 8 00:09:18.634609803 (14h29m53.149712376s) [upload=14909]: Starting upload Aug 8 00:09:18.634680614 (14h29m53.149783189s) [upload=14909]: Done starting upload Aug 8 00:09:18.634765976 (14h29m53.149868543s) [upload=14909]: Uploading segments... Aug 8 00:09:18.634815721 (14h29m53.1499183s) [upload=14909]: Got next segment. Inline: true Aug 8 00:09:18.634820719 (14h29m53.149923286s) [upload=14909]: Waiting for error group managing segments... Aug 8 00:09:18.634863856 (14h29m53.149966435s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:09:18.634868286 (14h29m53.149970863s) [upload=14909]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:09:18.634872291 (14h29m53.14997487s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:09:18.642683461 (14h29m53.157786047s) [upload=14909]: Done uploading segments... Aug 8 00:09:18.642703785 (14h29m53.157806368s) [upload=14909]: Upload finished. err: metaclient: Too Many Requests Duration: 179.153263ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.....................................X] duration: 40.294615ms FAIL (2025-08-08 00:53:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 48 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122292523 (15h13m52.6373951s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.122655357 (15h13m52.637757933s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127239504 (15h13m52.642342091s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127688378 (15h13m52.642790961s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.127985843 (15h13m52.643088424s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128258315 (15h13m52.643360891s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128584811 (15h13m52.643687396s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.128946611 (15h13m52.6440492s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129325847 (15h13m52.644428426s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.129642657 (15h13m52.644745251s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130117633 (15h13m52.645220215s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130438929 (15h13m52.645541508s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.130845916 (15h13m52.645948501s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131182211 (15h13m52.646284778s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.131530486 (15h13m52.646633071s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Uploading piece... Aug 8 00:53:18.230607322 (15h13m52.74570989s) [upload=15682]: Next returned nil segment Aug 8 00:53:18.230623159 (15h13m52.745725725s) [upload=15682]: Waiting for error group managing segments... Aug 8 00:53:18.242749045 (15h13m52.757851614s) [noise=true , address=104.36.82.60:4348 , piece_id=ZKLZJRIO723L2COYKZ7VBLW3XUXNKUX6TSI4ANI5PT4PRJDXVPPA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.244576549 (15h13m52.759679116s) [noise=true , address=104.36.82.44:4887 , piece_id=OVQVBZPHP4K5J2NZGQ5GWKXM2Y4PONIHSABXA2RO2LA4NTOZQOIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.251827136 (15h13m52.766929705s) [noise=true , address=104.36.82.23:4456 , piece_id=5YWV7LPEYQRDB4YQMU6IUXUIVTTEUPWTYYVIAHYPNIOOUVDPQY2Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.252451281 (15h13m52.767553856s) [noise=true , address=104.36.82.16:4314 , piece_id=RW2O5DE6EJWUP2Z6IMAL6KUMCCE5Y4L6HZB7RVJIWRBKPQ6R3OSA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.253652377 (15h13m52.768754952s) [noise=true , address=104.36.82.62:4436 , piece_id=SKTKM7TAQ3AUZQKVZ7WF3MU42UUILXWD2PJBAERN2CTMCGGSDAMA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.262606397 (15h13m52.777708985s) [noise=true , address=104.36.82.11:4117 , piece_id=H7NHN6523ULSHPVXABIQXJVMXL3YMPGHXPBLQUFFQ42YRSOAC3NQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.265863723 (15h13m52.780966304s) [noise=true , address=104.36.82.3:4792 , piece_id=2KBSC7QL2NP3HNZ7SZYQKDQOFZL6EFVHQZHJA6DGYM4LDXXEXNRA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.266994624 (15h13m52.78209719s) [noise=true , address=104.36.82.39:4732 , piece_id=V7DFYXEGQWT5DZIWS6XLANWGBGLHWAUZHSTZ45HRU7X7NSR5GWIA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270637696 (15h13m52.785740258s) [noise=true , address=104.36.82.54:4181 , piece_id=6QYOCEAAN56H37T3OPMVSAMGRFJKSYNSV6OF6YIB3TPC2EP3MQTA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.270741606 (15h13m52.78584417s) [noise=true , address=104.36.82.47:4552 , piece_id=ULDPQPGYZUTQXTGA46VFZH5VSYPTWSY4VIXH7FEV6CWXF2OHRQSQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.275223534 (15h13m52.790326108s) [noise=true , address=104.36.82.4:4814 , piece_id=OUTM5XGOWY2BHJM4FWTDCJI277QYUWIPC56GSLQMYHEPC5OCH54Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.287208624 (15h13m52.802311194s) [noise=true , address=104.36.82.8:4002 , piece_id=5QU2DJ43QHOD326EZQHUDSISYP3JSTAMFZQBT2Z5JM6YGXEGHVUA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.298071431 (15h13m52.813174s) [noise=true , address=104.36.82.59:4319 , piece_id=FB7GZQQJYNLXEY23VTMTQLIPIAZENNEII77LFUGPDH3SAWFTLRQA, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355392162 (15h13m52.870494741s) [noise=true , address=104.36.82.54:4188 , piece_id=QYQVT26JBLEB4WX62GA2BNVMKUIZHMMUQ2X5J2QQZXCANMNDMWWQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: <nil> Aug 8 00:53:18.355421695 (15h13m52.870524272s) [seg_pos={0 0}, upload=15682]: Segment reached optimal threshold of 14 pieces. Aug 8 00:53:18.355889099 (15h13m52.870991662s) [noise=true , address=64.49.13.170:4726 , piece_id=IAZG5BX624Q3S5JBBL7DKK7DELJJKOFUTY3ZM27T5IC4QMC76NRQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o5oB3BoEaPzgXKcqLwvPpjNtS9hNFBZ7zgh7EJhegVRjagakC): protocol: read tcp 159.223.143.39:35006->64.49.13.170:4726: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355942822 (15h13m52.87104539s) [noise=true , address=79.127.205.233:4627 , piece_id=YGXK4MII44PCFLZMA5IJ2T4TNYKPPRH5TR4G4ECC7NMEYLJ3EY3Q, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124uts4vuBSzwvxtAVPCX2jF7gxEcJrBXGgfNRi3rWM2279NCgm): protocol: read tcp 159.223.143.39:48546->79.127.205.233:4627: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355964966 (15h13m52.871067528s) [noise=true , address=64.49.13.139:4474 , piece_id=O6H7JRJ5ZVKOQEBGC3DDEB2XQJFFXL2B5EKBIQQA23OC3QTTUXIQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: read tcp 159.223.143.39:39484->64.49.13.139:4474: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.355991288 (15h13m52.87109385s) [noise=true , address=79.127.205.233:4631 , piece_id=KIA4EYX5MYCV2TV4EQ3WILY36AYC3QRVR55WE5N3DW3R4JR3A5UQ, seg_pos={0 0}, upload=15682]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tNcNixo72dz84o6bJjxoAnDByxLeHwEDBBwNrE3R5MvTCRr4v): protocol: read tcp 159.223.143.39:44010->79.127.205.233:4631: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 00:53:18.356018268 (15h13m52.871120829s) [seg_pos={0 0}, upload=15682]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:53:18.356076234 (15h13m52.87117881s) [upload=15682]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:53:18.356079897 (15h13m52.871182474s) [upload=15682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:53:18.412919044 (15h13m52.928021629s) [upload=15682]: Done uploading segments... Aug 8 00:53:18.412957531 (15h13m52.928060122s) [upload=15682]: Upload finished. err: <nil> Aug 8 00:53:51.325422002 (15h14m25.84052457s) [upload=15691]: Starting upload Aug 8 00:53:51.325472857 (15h14m25.840575433s) [upload=15691]: Done starting upload Aug 8 00:53:51.325560802 (15h14m25.84066337s) [upload=15691]: Uploading segments... Aug 8 00:53:51.325741160 (15h14m25.84084374s) [upload=15691]: Got next segment. Inline: false Aug 8 00:53:51.325779261 (15h14m25.840881829s) [upload=15691]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:53:51.325783783 (15h14m25.840886359s) [upload=15691]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:53:51.334218294 (15h14m25.849320873s) [upload=15691]: Next segment err: metaclient: Too Many Requests Aug 8 00:53:51.334246922 (15h14m25.849349485s) [upload=15691]: Done uploading segments... Aug 8 00:53:51.334262232 (15h14m25.849364794s) [upload=15691]: Upload finished. err: metaclient: Too Many Requests Duration: 40.335081ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 513.17048ms FAIL (2025-08-08 00:53:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ) [upload=15225]: Uploading segments... Aug 8 00:27:17.247676847 (14h47m51.762779424s) [upload=15225]: Got next segment. Inline: false Aug 8 00:27:17.247721996 (14h47m51.762824562s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:27:17.247727528 (14h47m51.762830101s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:27:17.291545729 (14h47m51.806648308s) [seg_pos={0 0}, upload=15225]: Begin upload segment... Aug 8 00:27:17.291590761 (14h47m51.806693337s) [seg_pos={0 0}, upload=15225]: Done begin upload segment. Aug 8 00:27:17.291631943 (14h47m51.806734519s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292350161 (14h47m51.807452747s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292862589 (14h47m51.807965158s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293356653 (14h47m51.80845923s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293694765 (14h47m51.80879733s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294102126 (14h47m51.809204705s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294457024 (14h47m51.809559649s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.295762993 (14h47m51.810865579s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.297221012 (14h47m51.812323592s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.298415523 (14h47m51.813518102s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299170586 (14h47m51.814273165s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299586634 (14h47m51.81468922s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300505377 (14h47m51.815607954s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300910486 (14h47m51.816013065s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.301313473 (14h47m51.816416052s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302240248 (14h47m51.817342831s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302660216 (14h47m51.817762801s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.303320933 (14h47m51.818423632s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.384020479 (14h47m51.899123063s) [upload=15225]: Next returned nil segment Aug 8 00:27:17.384038984 (14h47m51.89914157s) [upload=15225]: Waiting for error group managing segments... Aug 8 00:27:17.396462311 (14h47m51.911564953s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428089069 (14h47m51.943191637s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428197820 (14h47m51.943300395s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429065580 (14h47m51.94416816s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429798850 (14h47m51.944901413s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.430471949 (14h47m51.945574528s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.431184975 (14h47m51.946287543s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.446861505 (14h47m51.961964068s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.457827988 (14h47m51.97293057s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.526482208 (14h47m52.041584776s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.589478551 (14h47m52.10458112s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.619406819 (14h47m52.134509387s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.779336776 (14h47m52.294439354s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901796739 (14h47m52.416899309s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901837818 (14h47m52.416940395s) [seg_pos={0 0}, upload=15225]: Segment reached optimal threshold of 14 pieces. Aug 8 00:27:17.902063495 (14h47m52.417166078s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902253593 (14h47m52.417356165s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eSiwZPVoVzJ6RhkoWL1khLGbAgM743dPBxSTK6k8mNhxf79VH): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902332676 (14h47m52.417435243s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902546674 (14h47m52.417649253s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection Aug 8 00:27:17.902567693 (14h47m52.417670272s) [seg_pos={0 0}, upload=15225]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:27:17.902675722 (14h47m52.417778301s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:27:17.902682592 (14h47m52.41778517s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:27:17.996275903 (14h47m52.511378493s) [upload=15225]: Done uploading segments... Aug 8 00:27:17.996299184 (14h47m52.511401765s) [upload=15225]: Upload finished. err: <nil> Duration: 513.193228ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 294.169806ms FAIL (2025-08-08 00:53:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== g segments... Aug 8 00:01:46.657245436 (14h22m21.172348015s) [upload=14780]: Upload finished. err: <nil> Aug 8 00:02:30.275266890 (14h23m4.790369467s) [upload=14795]: Starting upload Aug 8 00:02:30.275331708 (14h23m4.790434285s) [upload=14795]: Done starting upload Aug 8 00:02:30.275419113 (14h23m4.790521681s) [upload=14795]: Uploading segments... Aug 8 00:02:30.275464303 (14h23m4.790566902s) [upload=14795]: Got next segment. Inline: true Aug 8 00:02:30.275470409 (14h23m4.790572986s) [upload=14795]: Waiting for error group managing segments... Aug 8 00:02:30.275541468 (14h23m4.790644064s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:02:30.275548435 (14h23m4.790651025s) [upload=14795]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:02:30.275553112 (14h23m4.790655694s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:02:30.437129275 (14h23m4.952231852s) [upload=14795]: Done uploading segments... Aug 8 00:02:30.437147837 (14h23m4.952250404s) [upload=14795]: Upload finished. err: <nil> Aug 8 00:03:02.216029168 (14h23m36.731131753s) [upload=14801]: Starting upload Aug 8 00:03:02.216131444 (14h23m36.731234024s) [upload=14801]: Done starting upload Aug 8 00:03:02.216223262 (14h23m36.731325836s) [upload=14801]: Uploading segments... Aug 8 00:03:02.216305099 (14h23m36.731407689s) [upload=14801]: Got next segment. Inline: true Aug 8 00:03:02.216311582 (14h23m36.731414165s) [upload=14801]: Waiting for error group managing segments... Aug 8 00:03:02.216381029 (14h23m36.731483612s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:02.216386785 (14h23m36.731489374s) [upload=14801]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:02.216390618 (14h23m36.731493197s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:02.283802345 (14h23m36.798904923s) [upload=14801]: Done uploading segments... Aug 8 00:03:02.283823305 (14h23m36.798925889s) [upload=14801]: Upload finished. err: <nil> Aug 8 00:03:30.509760483 (14h24m5.024863047s) [upload=14812]: Starting upload Aug 8 00:03:30.509815323 (14h24m5.024917908s) [upload=14812]: Done starting upload Aug 8 00:03:30.509926692 (14h24m5.02502927s) [upload=14812]: Uploading segments... Aug 8 00:03:30.509996173 (14h24m5.025098754s) [upload=14812]: Got next segment. Inline: true Aug 8 00:03:30.510002796 (14h24m5.025105377s) [upload=14812]: Waiting for error group managing segments... Aug 8 00:03:30.510068440 (14h24m5.025171017s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:30.510074098 (14h24m5.025176685s) [upload=14812]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:30.510077690 (14h24m5.025180273s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:30.698239096 (14h24m5.213341663s) [upload=14812]: Done uploading segments... Aug 8 00:03:30.698256740 (14h24m5.213359308s) [upload=14812]: Upload finished. err: <nil> Aug 8 00:04:41.065788390 (14h25m15.580890975s) [upload=14831]: Starting upload Aug 8 00:04:41.065849488 (14h25m15.580952064s) [upload=14831]: Done starting upload Aug 8 00:04:41.065914279 (14h25m15.581016856s) [upload=14831]: Uploading segments... Aug 8 00:04:41.065955528 (14h25m15.581058114s) [upload=14831]: Got next segment. Inline: true Aug 8 00:04:41.065961233 (14h25m15.581063813s) [upload=14831]: Waiting for error group managing segments... Aug 8 00:04:41.066010814 (14h25m15.581113395s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:41.066015217 (14h25m15.581117797s) [upload=14831]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:41.066019044 (14h25m15.581121626s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:41.143560517 (14h25m15.658663093s) [upload=14831]: Done uploading segments... Aug 8 00:04:41.143578273 (14h25m15.658680839s) [upload=14831]: Upload finished. err: <nil> Aug 8 00:04:57.174663208 (14h25m31.689765785s) [upload=14836]: Starting upload Aug 8 00:04:57.174738504 (14h25m31.68984108s) [upload=14836]: Done starting upload Aug 8 00:04:57.174818503 (14h25m31.689921072s) [upload=14836]: Uploading segments... Aug 8 00:04:57.174883379 (14h25m31.689985957s) [upload=14836]: Got next segment. Inline: true Aug 8 00:04:57.174888780 (14h25m31.689991347s) [upload=14836]: Waiting for error group managing segments... Aug 8 00:04:57.174955675 (14h25m31.690058262s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:57.174962095 (14h25m31.69006468s) [upload=14836]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:57.174966595 (14h25m31.690069178s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:57.317214071 (14h25m31.832316638s) [upload=14836]: Done uploading segments... Aug 8 00:04:57.317241163 (14h25m31.832343733s) [upload=14836]: Upload finished. err: <nil> Aug 8 00:06:06.741579891 (14h26m41.256682461s) [upload=14855]: Starting upload Aug 8 00:06:06.741694208 (14h26m41.256796791s) [upload=14855]: Done starting upload Aug 8 00:06:06.741776231 (14h26m41.256878801s) [upload=14855]: Uploading segments... Aug 8 00:06:06.741863808 (14h26m41.256966377s) [upload=14855]: Got next segment. Inline: true Aug 8 00:06:06.741870254 (14h26m41.25697283s) [upload=14855]: Waiting for error group managing segments... Aug 8 00:06:06.741939630 (14h26m41.257042211s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:06.741944620 (14h26m41.257047201s) [upload=14855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:06.741950358 (14h26m41.257052937s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:07.276784579 (14h26m41.791887173s) [upload=14855]: Done uploading segments... Aug 8 00:06:07.276805845 (14h26m41.79190841s) [upload=14855]: Upload finished. err: <nil> Aug 8 00:06:43.194994307 (14h27m17.710096878s) [upload=14865]: Starting upload Aug 8 00:06:43.195063177 (14h27m17.710165753s) [upload=14865]: Done starting upload Aug 8 00:06:43.195131851 (14h27m17.710234419s) [upload=14865]: Uploading segments... Aug 8 00:06:43.195200076 (14h27m17.710302661s) [upload=14865]: Got next segment. Inline: true Aug 8 00:06:43.195205915 (14h27m17.710308491s) [upload=14865]: Waiting for error group managing segments... Aug 8 00:06:43.195271114 (14h27m17.710373692s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:43.195276311 (14h27m17.710378889s) [upload=14865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:43.195279806 (14h27m17.710382383s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:43.430698626 (14h27m17.945801203s) [upload=14865]: Done uploading segments... Aug 8 00:06:43.430715582 (14h27m17.945818158s) [upload=14865]: Upload finished. err: <nil> Aug 8 00:07:00.838748208 (14h27m35.353850791s) [upload=14870]: Starting upload Aug 8 00:07:00.838831814 (14h27m35.353934397s) [upload=14870]: Done starting upload Aug 8 00:07:00.838944876 (14h27m35.354047439s) [upload=14870]: Uploading segments... Aug 8 00:07:00.839014925 (14h27m35.354117501s) [upload=14870]: Got next segment. Inline: true Aug 8 00:07:00.839045878 (14h27m35.354148457s) [upload=14870]: Waiting for error group managing segments... Aug 8 00:07:00.839120971 (14h27m35.354223549s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:07:00.839126346 (14h27m35.354228923s) [upload=14870]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:07:00.839129942 (14h27m35.354232518s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:07:00.932912415 (14h27m35.448014989s) [upload=14870]: Done uploading segments... Aug 8 00:07:00.932927726 (14h27m35.448030289s) [upload=14870]: Upload finished. err: <nil> Aug 8 00:08:14.384482900 (14h28m48.899585476s) [upload=14888]: Starting upload Aug 8 00:08:14.384593866 (14h28m48.899696446s) [upload=14888]: Done starting upload Aug 8 00:08:14.384673686 (14h28m48.899776254s) [upload=14888]: Uploading segments... Aug 8 00:08:14.384718832 (14h28m48.899821412s) [upload=14888]: Got next segment. Inline: true Aug 8 00:08:14.384723835 (14h28m48.899826412s) [upload=14888]: Waiting for error group managing segments... Aug 8 00:08:14.384763544 (14h28m48.89986612s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:08:14.384768731 (14h28m48.899871307s) [upload=14888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:08:14.384771994 (14h28m48.89987457s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:08:14.710769235 (14h28m49.225871818s) [upload=14888]: Done uploading segments... Aug 8 00:08:14.710803190 (14h28m49.225905767s) [upload=14888]: Upload finished. err: <nil> Aug 8 00:09:18.634609803 (14h29m53.149712376s) [upload=14909]: Starting upload Aug 8 00:09:18.634680614 (14h29m53.149783189s) [upload=14909]: Done starting upload Aug 8 00:09:18.634765976 (14h29m53.149868543s) [upload=14909]: Uploading segments... Aug 8 00:09:18.634815721 (14h29m53.1499183s) [upload=14909]: Got next segment. Inline: true Aug 8 00:09:18.634820719 (14h29m53.149923286s) [upload=14909]: Waiting for error group managing segments... Aug 8 00:09:18.634863856 (14h29m53.149966435s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:09:18.634868286 (14h29m53.149970863s) [upload=14909]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:09:18.634872291 (14h29m53.14997487s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:09:18.642683461 (14h29m53.157786047s) [upload=14909]: Done uploading segments... Aug 8 00:09:18.642703785 (14h29m53.157806368s) [upload=14909]: Upload finished. err: metaclient: Too Many Requests Duration: 294.20468ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 197.011127ms FAIL (2025-08-08 00:52:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== g segments... Aug 8 00:01:46.657245436 (14h22m21.172348015s) [upload=14780]: Upload finished. err: <nil> Aug 8 00:02:30.275266890 (14h23m4.790369467s) [upload=14795]: Starting upload Aug 8 00:02:30.275331708 (14h23m4.790434285s) [upload=14795]: Done starting upload Aug 8 00:02:30.275419113 (14h23m4.790521681s) [upload=14795]: Uploading segments... Aug 8 00:02:30.275464303 (14h23m4.790566902s) [upload=14795]: Got next segment. Inline: true Aug 8 00:02:30.275470409 (14h23m4.790572986s) [upload=14795]: Waiting for error group managing segments... Aug 8 00:02:30.275541468 (14h23m4.790644064s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:02:30.275548435 (14h23m4.790651025s) [upload=14795]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:02:30.275553112 (14h23m4.790655694s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:02:30.437129275 (14h23m4.952231852s) [upload=14795]: Done uploading segments... Aug 8 00:02:30.437147837 (14h23m4.952250404s) [upload=14795]: Upload finished. err: <nil> Aug 8 00:03:02.216029168 (14h23m36.731131753s) [upload=14801]: Starting upload Aug 8 00:03:02.216131444 (14h23m36.731234024s) [upload=14801]: Done starting upload Aug 8 00:03:02.216223262 (14h23m36.731325836s) [upload=14801]: Uploading segments... Aug 8 00:03:02.216305099 (14h23m36.731407689s) [upload=14801]: Got next segment. Inline: true Aug 8 00:03:02.216311582 (14h23m36.731414165s) [upload=14801]: Waiting for error group managing segments... Aug 8 00:03:02.216381029 (14h23m36.731483612s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:02.216386785 (14h23m36.731489374s) [upload=14801]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:02.216390618 (14h23m36.731493197s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:02.283802345 (14h23m36.798904923s) [upload=14801]: Done uploading segments... Aug 8 00:03:02.283823305 (14h23m36.798925889s) [upload=14801]: Upload finished. err: <nil> Aug 8 00:03:30.509760483 (14h24m5.024863047s) [upload=14812]: Starting upload Aug 8 00:03:30.509815323 (14h24m5.024917908s) [upload=14812]: Done starting upload Aug 8 00:03:30.509926692 (14h24m5.02502927s) [upload=14812]: Uploading segments... Aug 8 00:03:30.509996173 (14h24m5.025098754s) [upload=14812]: Got next segment. Inline: true Aug 8 00:03:30.510002796 (14h24m5.025105377s) [upload=14812]: Waiting for error group managing segments... Aug 8 00:03:30.510068440 (14h24m5.025171017s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:30.510074098 (14h24m5.025176685s) [upload=14812]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:30.510077690 (14h24m5.025180273s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:30.698239096 (14h24m5.213341663s) [upload=14812]: Done uploading segments... Aug 8 00:03:30.698256740 (14h24m5.213359308s) [upload=14812]: Upload finished. err: <nil> Aug 8 00:04:41.065788390 (14h25m15.580890975s) [upload=14831]: Starting upload Aug 8 00:04:41.065849488 (14h25m15.580952064s) [upload=14831]: Done starting upload Aug 8 00:04:41.065914279 (14h25m15.581016856s) [upload=14831]: Uploading segments... Aug 8 00:04:41.065955528 (14h25m15.581058114s) [upload=14831]: Got next segment. Inline: true Aug 8 00:04:41.065961233 (14h25m15.581063813s) [upload=14831]: Waiting for error group managing segments... Aug 8 00:04:41.066010814 (14h25m15.581113395s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:41.066015217 (14h25m15.581117797s) [upload=14831]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:41.066019044 (14h25m15.581121626s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:41.143560517 (14h25m15.658663093s) [upload=14831]: Done uploading segments... Aug 8 00:04:41.143578273 (14h25m15.658680839s) [upload=14831]: Upload finished. err: <nil> Aug 8 00:04:57.174663208 (14h25m31.689765785s) [upload=14836]: Starting upload Aug 8 00:04:57.174738504 (14h25m31.68984108s) [upload=14836]: Done starting upload Aug 8 00:04:57.174818503 (14h25m31.689921072s) [upload=14836]: Uploading segments... Aug 8 00:04:57.174883379 (14h25m31.689985957s) [upload=14836]: Got next segment. Inline: true Aug 8 00:04:57.174888780 (14h25m31.689991347s) [upload=14836]: Waiting for error group managing segments... Aug 8 00:04:57.174955675 (14h25m31.690058262s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:57.174962095 (14h25m31.69006468s) [upload=14836]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:57.174966595 (14h25m31.690069178s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:57.317214071 (14h25m31.832316638s) [upload=14836]: Done uploading segments... Aug 8 00:04:57.317241163 (14h25m31.832343733s) [upload=14836]: Upload finished. err: <nil> Aug 8 00:06:06.741579891 (14h26m41.256682461s) [upload=14855]: Starting upload Aug 8 00:06:06.741694208 (14h26m41.256796791s) [upload=14855]: Done starting upload Aug 8 00:06:06.741776231 (14h26m41.256878801s) [upload=14855]: Uploading segments... Aug 8 00:06:06.741863808 (14h26m41.256966377s) [upload=14855]: Got next segment. Inline: true Aug 8 00:06:06.741870254 (14h26m41.25697283s) [upload=14855]: Waiting for error group managing segments... Aug 8 00:06:06.741939630 (14h26m41.257042211s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:06.741944620 (14h26m41.257047201s) [upload=14855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:06.741950358 (14h26m41.257052937s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:07.276784579 (14h26m41.791887173s) [upload=14855]: Done uploading segments... Aug 8 00:06:07.276805845 (14h26m41.79190841s) [upload=14855]: Upload finished. err: <nil> Aug 8 00:06:43.194994307 (14h27m17.710096878s) [upload=14865]: Starting upload Aug 8 00:06:43.195063177 (14h27m17.710165753s) [upload=14865]: Done starting upload Aug 8 00:06:43.195131851 (14h27m17.710234419s) [upload=14865]: Uploading segments... Aug 8 00:06:43.195200076 (14h27m17.710302661s) [upload=14865]: Got next segment. Inline: true Aug 8 00:06:43.195205915 (14h27m17.710308491s) [upload=14865]: Waiting for error group managing segments... Aug 8 00:06:43.195271114 (14h27m17.710373692s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:43.195276311 (14h27m17.710378889s) [upload=14865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:43.195279806 (14h27m17.710382383s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:43.430698626 (14h27m17.945801203s) [upload=14865]: Done uploading segments... Aug 8 00:06:43.430715582 (14h27m17.945818158s) [upload=14865]: Upload finished. err: <nil> Aug 8 00:07:00.838748208 (14h27m35.353850791s) [upload=14870]: Starting upload Aug 8 00:07:00.838831814 (14h27m35.353934397s) [upload=14870]: Done starting upload Aug 8 00:07:00.838944876 (14h27m35.354047439s) [upload=14870]: Uploading segments... Aug 8 00:07:00.839014925 (14h27m35.354117501s) [upload=14870]: Got next segment. Inline: true Aug 8 00:07:00.839045878 (14h27m35.354148457s) [upload=14870]: Waiting for error group managing segments... Aug 8 00:07:00.839120971 (14h27m35.354223549s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:07:00.839126346 (14h27m35.354228923s) [upload=14870]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:07:00.839129942 (14h27m35.354232518s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:07:00.932912415 (14h27m35.448014989s) [upload=14870]: Done uploading segments... Aug 8 00:07:00.932927726 (14h27m35.448030289s) [upload=14870]: Upload finished. err: <nil> Aug 8 00:08:14.384482900 (14h28m48.899585476s) [upload=14888]: Starting upload Aug 8 00:08:14.384593866 (14h28m48.899696446s) [upload=14888]: Done starting upload Aug 8 00:08:14.384673686 (14h28m48.899776254s) [upload=14888]: Uploading segments... Aug 8 00:08:14.384718832 (14h28m48.899821412s) [upload=14888]: Got next segment. Inline: true Aug 8 00:08:14.384723835 (14h28m48.899826412s) [upload=14888]: Waiting for error group managing segments... Aug 8 00:08:14.384763544 (14h28m48.89986612s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:08:14.384768731 (14h28m48.899871307s) [upload=14888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:08:14.384771994 (14h28m48.89987457s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:08:14.710769235 (14h28m49.225871818s) [upload=14888]: Done uploading segments... Aug 8 00:08:14.710803190 (14h28m49.225905767s) [upload=14888]: Upload finished. err: <nil> Aug 8 00:09:18.634609803 (14h29m53.149712376s) [upload=14909]: Starting upload Aug 8 00:09:18.634680614 (14h29m53.149783189s) [upload=14909]: Done starting upload Aug 8 00:09:18.634765976 (14h29m53.149868543s) [upload=14909]: Uploading segments... Aug 8 00:09:18.634815721 (14h29m53.1499183s) [upload=14909]: Got next segment. Inline: true Aug 8 00:09:18.634820719 (14h29m53.149923286s) [upload=14909]: Waiting for error group managing segments... Aug 8 00:09:18.634863856 (14h29m53.149966435s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:09:18.634868286 (14h29m53.149970863s) [upload=14909]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:09:18.634872291 (14h29m53.14997487s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:09:18.642683461 (14h29m53.157786047s) [upload=14909]: Done uploading segments... Aug 8 00:09:18.642703785 (14h29m53.157806368s) [upload=14909]: Upload finished. err: metaclient: Too Many Requests Duration: 197.040001ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X......................X....................................] duration: 720.557579ms FAIL (2025-08-08 00:52:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ) [upload=15225]: Uploading segments... Aug 8 00:27:17.247676847 (14h47m51.762779424s) [upload=15225]: Got next segment. Inline: false Aug 8 00:27:17.247721996 (14h47m51.762824562s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:27:17.247727528 (14h47m51.762830101s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:27:17.291545729 (14h47m51.806648308s) [seg_pos={0 0}, upload=15225]: Begin upload segment... Aug 8 00:27:17.291590761 (14h47m51.806693337s) [seg_pos={0 0}, upload=15225]: Done begin upload segment. Aug 8 00:27:17.291631943 (14h47m51.806734519s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292350161 (14h47m51.807452747s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292862589 (14h47m51.807965158s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293356653 (14h47m51.80845923s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293694765 (14h47m51.80879733s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294102126 (14h47m51.809204705s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294457024 (14h47m51.809559649s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.295762993 (14h47m51.810865579s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.297221012 (14h47m51.812323592s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.298415523 (14h47m51.813518102s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299170586 (14h47m51.814273165s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299586634 (14h47m51.81468922s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300505377 (14h47m51.815607954s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300910486 (14h47m51.816013065s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.301313473 (14h47m51.816416052s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302240248 (14h47m51.817342831s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302660216 (14h47m51.817762801s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.303320933 (14h47m51.818423632s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.384020479 (14h47m51.899123063s) [upload=15225]: Next returned nil segment Aug 8 00:27:17.384038984 (14h47m51.89914157s) [upload=15225]: Waiting for error group managing segments... Aug 8 00:27:17.396462311 (14h47m51.911564953s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428089069 (14h47m51.943191637s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428197820 (14h47m51.943300395s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429065580 (14h47m51.94416816s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429798850 (14h47m51.944901413s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.430471949 (14h47m51.945574528s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.431184975 (14h47m51.946287543s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.446861505 (14h47m51.961964068s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.457827988 (14h47m51.97293057s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.526482208 (14h47m52.041584776s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.589478551 (14h47m52.10458112s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.619406819 (14h47m52.134509387s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.779336776 (14h47m52.294439354s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901796739 (14h47m52.416899309s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901837818 (14h47m52.416940395s) [seg_pos={0 0}, upload=15225]: Segment reached optimal threshold of 14 pieces. Aug 8 00:27:17.902063495 (14h47m52.417166078s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902253593 (14h47m52.417356165s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eSiwZPVoVzJ6RhkoWL1khLGbAgM743dPBxSTK6k8mNhxf79VH): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902332676 (14h47m52.417435243s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902546674 (14h47m52.417649253s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection Aug 8 00:27:17.902567693 (14h47m52.417670272s) [seg_pos={0 0}, upload=15225]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:27:17.902675722 (14h47m52.417778301s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:27:17.902682592 (14h47m52.41778517s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:27:17.996275903 (14h47m52.511378493s) [upload=15225]: Done uploading segments... Aug 8 00:27:17.996299184 (14h47m52.511401765s) [upload=15225]: Upload finished. err: <nil> Duration: 720.581488ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X......................X...................................] duration: 982.362273ms FAIL (2025-08-08 00:51:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ) [upload=15225]: Uploading segments... Aug 8 00:27:17.247676847 (14h47m51.762779424s) [upload=15225]: Got next segment. Inline: false Aug 8 00:27:17.247721996 (14h47m51.762824562s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:27:17.247727528 (14h47m51.762830101s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:27:17.291545729 (14h47m51.806648308s) [seg_pos={0 0}, upload=15225]: Begin upload segment... Aug 8 00:27:17.291590761 (14h47m51.806693337s) [seg_pos={0 0}, upload=15225]: Done begin upload segment. Aug 8 00:27:17.291631943 (14h47m51.806734519s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292350161 (14h47m51.807452747s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292862589 (14h47m51.807965158s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293356653 (14h47m51.80845923s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293694765 (14h47m51.80879733s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294102126 (14h47m51.809204705s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294457024 (14h47m51.809559649s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.295762993 (14h47m51.810865579s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.297221012 (14h47m51.812323592s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.298415523 (14h47m51.813518102s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299170586 (14h47m51.814273165s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299586634 (14h47m51.81468922s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300505377 (14h47m51.815607954s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300910486 (14h47m51.816013065s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.301313473 (14h47m51.816416052s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302240248 (14h47m51.817342831s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302660216 (14h47m51.817762801s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.303320933 (14h47m51.818423632s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.384020479 (14h47m51.899123063s) [upload=15225]: Next returned nil segment Aug 8 00:27:17.384038984 (14h47m51.89914157s) [upload=15225]: Waiting for error group managing segments... Aug 8 00:27:17.396462311 (14h47m51.911564953s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428089069 (14h47m51.943191637s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428197820 (14h47m51.943300395s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429065580 (14h47m51.94416816s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429798850 (14h47m51.944901413s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.430471949 (14h47m51.945574528s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.431184975 (14h47m51.946287543s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.446861505 (14h47m51.961964068s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.457827988 (14h47m51.97293057s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.526482208 (14h47m52.041584776s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.589478551 (14h47m52.10458112s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.619406819 (14h47m52.134509387s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.779336776 (14h47m52.294439354s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901796739 (14h47m52.416899309s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901837818 (14h47m52.416940395s) [seg_pos={0 0}, upload=15225]: Segment reached optimal threshold of 14 pieces. Aug 8 00:27:17.902063495 (14h47m52.417166078s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902253593 (14h47m52.417356165s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eSiwZPVoVzJ6RhkoWL1khLGbAgM743dPBxSTK6k8mNhxf79VH): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902332676 (14h47m52.417435243s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902546674 (14h47m52.417649253s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection Aug 8 00:27:17.902567693 (14h47m52.417670272s) [seg_pos={0 0}, upload=15225]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:27:17.902675722 (14h47m52.417778301s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:27:17.902682592 (14h47m52.41778517s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:27:17.996275903 (14h47m52.511378493s) [upload=15225]: Done uploading segments... Aug 8 00:27:17.996299184 (14h47m52.511401765s) [upload=15225]: Upload finished. err: <nil> Duration: 982.391578ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 436.906592ms FAIL (2025-08-08 00:51:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== g segments... Aug 8 00:01:46.657245436 (14h22m21.172348015s) [upload=14780]: Upload finished. err: <nil> Aug 8 00:02:30.275266890 (14h23m4.790369467s) [upload=14795]: Starting upload Aug 8 00:02:30.275331708 (14h23m4.790434285s) [upload=14795]: Done starting upload Aug 8 00:02:30.275419113 (14h23m4.790521681s) [upload=14795]: Uploading segments... Aug 8 00:02:30.275464303 (14h23m4.790566902s) [upload=14795]: Got next segment. Inline: true Aug 8 00:02:30.275470409 (14h23m4.790572986s) [upload=14795]: Waiting for error group managing segments... Aug 8 00:02:30.275541468 (14h23m4.790644064s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:02:30.275548435 (14h23m4.790651025s) [upload=14795]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:02:30.275553112 (14h23m4.790655694s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:02:30.437129275 (14h23m4.952231852s) [upload=14795]: Done uploading segments... Aug 8 00:02:30.437147837 (14h23m4.952250404s) [upload=14795]: Upload finished. err: <nil> Aug 8 00:03:02.216029168 (14h23m36.731131753s) [upload=14801]: Starting upload Aug 8 00:03:02.216131444 (14h23m36.731234024s) [upload=14801]: Done starting upload Aug 8 00:03:02.216223262 (14h23m36.731325836s) [upload=14801]: Uploading segments... Aug 8 00:03:02.216305099 (14h23m36.731407689s) [upload=14801]: Got next segment. Inline: true Aug 8 00:03:02.216311582 (14h23m36.731414165s) [upload=14801]: Waiting for error group managing segments... Aug 8 00:03:02.216381029 (14h23m36.731483612s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:02.216386785 (14h23m36.731489374s) [upload=14801]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:02.216390618 (14h23m36.731493197s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:02.283802345 (14h23m36.798904923s) [upload=14801]: Done uploading segments... Aug 8 00:03:02.283823305 (14h23m36.798925889s) [upload=14801]: Upload finished. err: <nil> Aug 8 00:03:30.509760483 (14h24m5.024863047s) [upload=14812]: Starting upload Aug 8 00:03:30.509815323 (14h24m5.024917908s) [upload=14812]: Done starting upload Aug 8 00:03:30.509926692 (14h24m5.02502927s) [upload=14812]: Uploading segments... Aug 8 00:03:30.509996173 (14h24m5.025098754s) [upload=14812]: Got next segment. Inline: true Aug 8 00:03:30.510002796 (14h24m5.025105377s) [upload=14812]: Waiting for error group managing segments... Aug 8 00:03:30.510068440 (14h24m5.025171017s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:30.510074098 (14h24m5.025176685s) [upload=14812]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:30.510077690 (14h24m5.025180273s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:30.698239096 (14h24m5.213341663s) [upload=14812]: Done uploading segments... Aug 8 00:03:30.698256740 (14h24m5.213359308s) [upload=14812]: Upload finished. err: <nil> Aug 8 00:04:41.065788390 (14h25m15.580890975s) [upload=14831]: Starting upload Aug 8 00:04:41.065849488 (14h25m15.580952064s) [upload=14831]: Done starting upload Aug 8 00:04:41.065914279 (14h25m15.581016856s) [upload=14831]: Uploading segments... Aug 8 00:04:41.065955528 (14h25m15.581058114s) [upload=14831]: Got next segment. Inline: true Aug 8 00:04:41.065961233 (14h25m15.581063813s) [upload=14831]: Waiting for error group managing segments... Aug 8 00:04:41.066010814 (14h25m15.581113395s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:41.066015217 (14h25m15.581117797s) [upload=14831]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:41.066019044 (14h25m15.581121626s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:41.143560517 (14h25m15.658663093s) [upload=14831]: Done uploading segments... Aug 8 00:04:41.143578273 (14h25m15.658680839s) [upload=14831]: Upload finished. err: <nil> Aug 8 00:04:57.174663208 (14h25m31.689765785s) [upload=14836]: Starting upload Aug 8 00:04:57.174738504 (14h25m31.68984108s) [upload=14836]: Done starting upload Aug 8 00:04:57.174818503 (14h25m31.689921072s) [upload=14836]: Uploading segments... Aug 8 00:04:57.174883379 (14h25m31.689985957s) [upload=14836]: Got next segment. Inline: true Aug 8 00:04:57.174888780 (14h25m31.689991347s) [upload=14836]: Waiting for error group managing segments... Aug 8 00:04:57.174955675 (14h25m31.690058262s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:57.174962095 (14h25m31.69006468s) [upload=14836]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:57.174966595 (14h25m31.690069178s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:57.317214071 (14h25m31.832316638s) [upload=14836]: Done uploading segments... Aug 8 00:04:57.317241163 (14h25m31.832343733s) [upload=14836]: Upload finished. err: <nil> Aug 8 00:06:06.741579891 (14h26m41.256682461s) [upload=14855]: Starting upload Aug 8 00:06:06.741694208 (14h26m41.256796791s) [upload=14855]: Done starting upload Aug 8 00:06:06.741776231 (14h26m41.256878801s) [upload=14855]: Uploading segments... Aug 8 00:06:06.741863808 (14h26m41.256966377s) [upload=14855]: Got next segment. Inline: true Aug 8 00:06:06.741870254 (14h26m41.25697283s) [upload=14855]: Waiting for error group managing segments... Aug 8 00:06:06.741939630 (14h26m41.257042211s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:06.741944620 (14h26m41.257047201s) [upload=14855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:06.741950358 (14h26m41.257052937s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:07.276784579 (14h26m41.791887173s) [upload=14855]: Done uploading segments... Aug 8 00:06:07.276805845 (14h26m41.79190841s) [upload=14855]: Upload finished. err: <nil> Aug 8 00:06:43.194994307 (14h27m17.710096878s) [upload=14865]: Starting upload Aug 8 00:06:43.195063177 (14h27m17.710165753s) [upload=14865]: Done starting upload Aug 8 00:06:43.195131851 (14h27m17.710234419s) [upload=14865]: Uploading segments... Aug 8 00:06:43.195200076 (14h27m17.710302661s) [upload=14865]: Got next segment. Inline: true Aug 8 00:06:43.195205915 (14h27m17.710308491s) [upload=14865]: Waiting for error group managing segments... Aug 8 00:06:43.195271114 (14h27m17.710373692s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:43.195276311 (14h27m17.710378889s) [upload=14865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:43.195279806 (14h27m17.710382383s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:43.430698626 (14h27m17.945801203s) [upload=14865]: Done uploading segments... Aug 8 00:06:43.430715582 (14h27m17.945818158s) [upload=14865]: Upload finished. err: <nil> Aug 8 00:07:00.838748208 (14h27m35.353850791s) [upload=14870]: Starting upload Aug 8 00:07:00.838831814 (14h27m35.353934397s) [upload=14870]: Done starting upload Aug 8 00:07:00.838944876 (14h27m35.354047439s) [upload=14870]: Uploading segments... Aug 8 00:07:00.839014925 (14h27m35.354117501s) [upload=14870]: Got next segment. Inline: true Aug 8 00:07:00.839045878 (14h27m35.354148457s) [upload=14870]: Waiting for error group managing segments... Aug 8 00:07:00.839120971 (14h27m35.354223549s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:07:00.839126346 (14h27m35.354228923s) [upload=14870]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:07:00.839129942 (14h27m35.354232518s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:07:00.932912415 (14h27m35.448014989s) [upload=14870]: Done uploading segments... Aug 8 00:07:00.932927726 (14h27m35.448030289s) [upload=14870]: Upload finished. err: <nil> Aug 8 00:08:14.384482900 (14h28m48.899585476s) [upload=14888]: Starting upload Aug 8 00:08:14.384593866 (14h28m48.899696446s) [upload=14888]: Done starting upload Aug 8 00:08:14.384673686 (14h28m48.899776254s) [upload=14888]: Uploading segments... Aug 8 00:08:14.384718832 (14h28m48.899821412s) [upload=14888]: Got next segment. Inline: true Aug 8 00:08:14.384723835 (14h28m48.899826412s) [upload=14888]: Waiting for error group managing segments... Aug 8 00:08:14.384763544 (14h28m48.89986612s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:08:14.384768731 (14h28m48.899871307s) [upload=14888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:08:14.384771994 (14h28m48.89987457s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:08:14.710769235 (14h28m49.225871818s) [upload=14888]: Done uploading segments... Aug 8 00:08:14.710803190 (14h28m49.225905767s) [upload=14888]: Upload finished. err: <nil> Aug 8 00:09:18.634609803 (14h29m53.149712376s) [upload=14909]: Starting upload Aug 8 00:09:18.634680614 (14h29m53.149783189s) [upload=14909]: Done starting upload Aug 8 00:09:18.634765976 (14h29m53.149868543s) [upload=14909]: Uploading segments... Aug 8 00:09:18.634815721 (14h29m53.1499183s) [upload=14909]: Got next segment. Inline: true Aug 8 00:09:18.634820719 (14h29m53.149923286s) [upload=14909]: Waiting for error group managing segments... Aug 8 00:09:18.634863856 (14h29m53.149966435s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:09:18.634868286 (14h29m53.149970863s) [upload=14909]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:09:18.634872291 (14h29m53.14997487s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:09:18.642683461 (14h29m53.157786047s) [upload=14909]: Done uploading segments... Aug 8 00:09:18.642703785 (14h29m53.157806368s) [upload=14909]: Upload finished. err: metaclient: Too Many Requests Duration: 436.935604ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 219.395893ms FAIL (2025-08-08 00:51:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== g segments... Aug 8 00:01:46.657245436 (14h22m21.172348015s) [upload=14780]: Upload finished. err: <nil> Aug 8 00:02:30.275266890 (14h23m4.790369467s) [upload=14795]: Starting upload Aug 8 00:02:30.275331708 (14h23m4.790434285s) [upload=14795]: Done starting upload Aug 8 00:02:30.275419113 (14h23m4.790521681s) [upload=14795]: Uploading segments... Aug 8 00:02:30.275464303 (14h23m4.790566902s) [upload=14795]: Got next segment. Inline: true Aug 8 00:02:30.275470409 (14h23m4.790572986s) [upload=14795]: Waiting for error group managing segments... Aug 8 00:02:30.275541468 (14h23m4.790644064s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:02:30.275548435 (14h23m4.790651025s) [upload=14795]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:02:30.275553112 (14h23m4.790655694s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:02:30.437129275 (14h23m4.952231852s) [upload=14795]: Done uploading segments... Aug 8 00:02:30.437147837 (14h23m4.952250404s) [upload=14795]: Upload finished. err: <nil> Aug 8 00:03:02.216029168 (14h23m36.731131753s) [upload=14801]: Starting upload Aug 8 00:03:02.216131444 (14h23m36.731234024s) [upload=14801]: Done starting upload Aug 8 00:03:02.216223262 (14h23m36.731325836s) [upload=14801]: Uploading segments... Aug 8 00:03:02.216305099 (14h23m36.731407689s) [upload=14801]: Got next segment. Inline: true Aug 8 00:03:02.216311582 (14h23m36.731414165s) [upload=14801]: Waiting for error group managing segments... Aug 8 00:03:02.216381029 (14h23m36.731483612s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:02.216386785 (14h23m36.731489374s) [upload=14801]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:02.216390618 (14h23m36.731493197s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:02.283802345 (14h23m36.798904923s) [upload=14801]: Done uploading segments... Aug 8 00:03:02.283823305 (14h23m36.798925889s) [upload=14801]: Upload finished. err: <nil> Aug 8 00:03:30.509760483 (14h24m5.024863047s) [upload=14812]: Starting upload Aug 8 00:03:30.509815323 (14h24m5.024917908s) [upload=14812]: Done starting upload Aug 8 00:03:30.509926692 (14h24m5.02502927s) [upload=14812]: Uploading segments... Aug 8 00:03:30.509996173 (14h24m5.025098754s) [upload=14812]: Got next segment. Inline: true Aug 8 00:03:30.510002796 (14h24m5.025105377s) [upload=14812]: Waiting for error group managing segments... Aug 8 00:03:30.510068440 (14h24m5.025171017s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:30.510074098 (14h24m5.025176685s) [upload=14812]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:30.510077690 (14h24m5.025180273s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:30.698239096 (14h24m5.213341663s) [upload=14812]: Done uploading segments... Aug 8 00:03:30.698256740 (14h24m5.213359308s) [upload=14812]: Upload finished. err: <nil> Aug 8 00:04:41.065788390 (14h25m15.580890975s) [upload=14831]: Starting upload Aug 8 00:04:41.065849488 (14h25m15.580952064s) [upload=14831]: Done starting upload Aug 8 00:04:41.065914279 (14h25m15.581016856s) [upload=14831]: Uploading segments... Aug 8 00:04:41.065955528 (14h25m15.581058114s) [upload=14831]: Got next segment. Inline: true Aug 8 00:04:41.065961233 (14h25m15.581063813s) [upload=14831]: Waiting for error group managing segments... Aug 8 00:04:41.066010814 (14h25m15.581113395s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:41.066015217 (14h25m15.581117797s) [upload=14831]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:41.066019044 (14h25m15.581121626s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:41.143560517 (14h25m15.658663093s) [upload=14831]: Done uploading segments... Aug 8 00:04:41.143578273 (14h25m15.658680839s) [upload=14831]: Upload finished. err: <nil> Aug 8 00:04:57.174663208 (14h25m31.689765785s) [upload=14836]: Starting upload Aug 8 00:04:57.174738504 (14h25m31.68984108s) [upload=14836]: Done starting upload Aug 8 00:04:57.174818503 (14h25m31.689921072s) [upload=14836]: Uploading segments... Aug 8 00:04:57.174883379 (14h25m31.689985957s) [upload=14836]: Got next segment. Inline: true Aug 8 00:04:57.174888780 (14h25m31.689991347s) [upload=14836]: Waiting for error group managing segments... Aug 8 00:04:57.174955675 (14h25m31.690058262s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:57.174962095 (14h25m31.69006468s) [upload=14836]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:57.174966595 (14h25m31.690069178s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:57.317214071 (14h25m31.832316638s) [upload=14836]: Done uploading segments... Aug 8 00:04:57.317241163 (14h25m31.832343733s) [upload=14836]: Upload finished. err: <nil> Aug 8 00:06:06.741579891 (14h26m41.256682461s) [upload=14855]: Starting upload Aug 8 00:06:06.741694208 (14h26m41.256796791s) [upload=14855]: Done starting upload Aug 8 00:06:06.741776231 (14h26m41.256878801s) [upload=14855]: Uploading segments... Aug 8 00:06:06.741863808 (14h26m41.256966377s) [upload=14855]: Got next segment. Inline: true Aug 8 00:06:06.741870254 (14h26m41.25697283s) [upload=14855]: Waiting for error group managing segments... Aug 8 00:06:06.741939630 (14h26m41.257042211s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:06.741944620 (14h26m41.257047201s) [upload=14855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:06.741950358 (14h26m41.257052937s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:07.276784579 (14h26m41.791887173s) [upload=14855]: Done uploading segments... Aug 8 00:06:07.276805845 (14h26m41.79190841s) [upload=14855]: Upload finished. err: <nil> Aug 8 00:06:43.194994307 (14h27m17.710096878s) [upload=14865]: Starting upload Aug 8 00:06:43.195063177 (14h27m17.710165753s) [upload=14865]: Done starting upload Aug 8 00:06:43.195131851 (14h27m17.710234419s) [upload=14865]: Uploading segments... Aug 8 00:06:43.195200076 (14h27m17.710302661s) [upload=14865]: Got next segment. Inline: true Aug 8 00:06:43.195205915 (14h27m17.710308491s) [upload=14865]: Waiting for error group managing segments... Aug 8 00:06:43.195271114 (14h27m17.710373692s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:43.195276311 (14h27m17.710378889s) [upload=14865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:43.195279806 (14h27m17.710382383s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:43.430698626 (14h27m17.945801203s) [upload=14865]: Done uploading segments... Aug 8 00:06:43.430715582 (14h27m17.945818158s) [upload=14865]: Upload finished. err: <nil> Aug 8 00:07:00.838748208 (14h27m35.353850791s) [upload=14870]: Starting upload Aug 8 00:07:00.838831814 (14h27m35.353934397s) [upload=14870]: Done starting upload Aug 8 00:07:00.838944876 (14h27m35.354047439s) [upload=14870]: Uploading segments... Aug 8 00:07:00.839014925 (14h27m35.354117501s) [upload=14870]: Got next segment. Inline: true Aug 8 00:07:00.839045878 (14h27m35.354148457s) [upload=14870]: Waiting for error group managing segments... Aug 8 00:07:00.839120971 (14h27m35.354223549s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:07:00.839126346 (14h27m35.354228923s) [upload=14870]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:07:00.839129942 (14h27m35.354232518s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:07:00.932912415 (14h27m35.448014989s) [upload=14870]: Done uploading segments... Aug 8 00:07:00.932927726 (14h27m35.448030289s) [upload=14870]: Upload finished. err: <nil> Aug 8 00:08:14.384482900 (14h28m48.899585476s) [upload=14888]: Starting upload Aug 8 00:08:14.384593866 (14h28m48.899696446s) [upload=14888]: Done starting upload Aug 8 00:08:14.384673686 (14h28m48.899776254s) [upload=14888]: Uploading segments... Aug 8 00:08:14.384718832 (14h28m48.899821412s) [upload=14888]: Got next segment. Inline: true Aug 8 00:08:14.384723835 (14h28m48.899826412s) [upload=14888]: Waiting for error group managing segments... Aug 8 00:08:14.384763544 (14h28m48.89986612s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:08:14.384768731 (14h28m48.899871307s) [upload=14888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:08:14.384771994 (14h28m48.89987457s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:08:14.710769235 (14h28m49.225871818s) [upload=14888]: Done uploading segments... Aug 8 00:08:14.710803190 (14h28m49.225905767s) [upload=14888]: Upload finished. err: <nil> Aug 8 00:09:18.634609803 (14h29m53.149712376s) [upload=14909]: Starting upload Aug 8 00:09:18.634680614 (14h29m53.149783189s) [upload=14909]: Done starting upload Aug 8 00:09:18.634765976 (14h29m53.149868543s) [upload=14909]: Uploading segments... Aug 8 00:09:18.634815721 (14h29m53.1499183s) [upload=14909]: Got next segment. Inline: true Aug 8 00:09:18.634820719 (14h29m53.149923286s) [upload=14909]: Waiting for error group managing segments... Aug 8 00:09:18.634863856 (14h29m53.149966435s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:09:18.634868286 (14h29m53.149970863s) [upload=14909]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:09:18.634872291 (14h29m53.14997487s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:09:18.642683461 (14h29m53.157786047s) [upload=14909]: Done uploading segments... Aug 8 00:09:18.642703785 (14h29m53.157806368s) [upload=14909]: Upload finished. err: metaclient: Too Many Requests Duration: 219.425986ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X......................X..................................] duration: 618.574775ms FAIL (2025-08-08 00:50:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ) [upload=15225]: Uploading segments... Aug 8 00:27:17.247676847 (14h47m51.762779424s) [upload=15225]: Got next segment. Inline: false Aug 8 00:27:17.247721996 (14h47m51.762824562s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:27:17.247727528 (14h47m51.762830101s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:27:17.291545729 (14h47m51.806648308s) [seg_pos={0 0}, upload=15225]: Begin upload segment... Aug 8 00:27:17.291590761 (14h47m51.806693337s) [seg_pos={0 0}, upload=15225]: Done begin upload segment. Aug 8 00:27:17.291631943 (14h47m51.806734519s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292350161 (14h47m51.807452747s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292862589 (14h47m51.807965158s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293356653 (14h47m51.80845923s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293694765 (14h47m51.80879733s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294102126 (14h47m51.809204705s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294457024 (14h47m51.809559649s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.295762993 (14h47m51.810865579s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.297221012 (14h47m51.812323592s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.298415523 (14h47m51.813518102s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299170586 (14h47m51.814273165s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299586634 (14h47m51.81468922s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300505377 (14h47m51.815607954s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300910486 (14h47m51.816013065s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.301313473 (14h47m51.816416052s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302240248 (14h47m51.817342831s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302660216 (14h47m51.817762801s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.303320933 (14h47m51.818423632s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.384020479 (14h47m51.899123063s) [upload=15225]: Next returned nil segment Aug 8 00:27:17.384038984 (14h47m51.89914157s) [upload=15225]: Waiting for error group managing segments... Aug 8 00:27:17.396462311 (14h47m51.911564953s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428089069 (14h47m51.943191637s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428197820 (14h47m51.943300395s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429065580 (14h47m51.94416816s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429798850 (14h47m51.944901413s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.430471949 (14h47m51.945574528s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.431184975 (14h47m51.946287543s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.446861505 (14h47m51.961964068s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.457827988 (14h47m51.97293057s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.526482208 (14h47m52.041584776s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.589478551 (14h47m52.10458112s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.619406819 (14h47m52.134509387s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.779336776 (14h47m52.294439354s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901796739 (14h47m52.416899309s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901837818 (14h47m52.416940395s) [seg_pos={0 0}, upload=15225]: Segment reached optimal threshold of 14 pieces. Aug 8 00:27:17.902063495 (14h47m52.417166078s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902253593 (14h47m52.417356165s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eSiwZPVoVzJ6RhkoWL1khLGbAgM743dPBxSTK6k8mNhxf79VH): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902332676 (14h47m52.417435243s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902546674 (14h47m52.417649253s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection Aug 8 00:27:17.902567693 (14h47m52.417670272s) [seg_pos={0 0}, upload=15225]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:27:17.902675722 (14h47m52.417778301s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:27:17.902682592 (14h47m52.41778517s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:27:17.996275903 (14h47m52.511378493s) [upload=15225]: Done uploading segments... Aug 8 00:27:17.996299184 (14h47m52.511401765s) [upload=15225]: Upload finished. err: <nil> Duration: 618.607545ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 333.970537ms FAIL (2025-08-08 00:50:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== g segments... Aug 8 00:01:46.657245436 (14h22m21.172348015s) [upload=14780]: Upload finished. err: <nil> Aug 8 00:02:30.275266890 (14h23m4.790369467s) [upload=14795]: Starting upload Aug 8 00:02:30.275331708 (14h23m4.790434285s) [upload=14795]: Done starting upload Aug 8 00:02:30.275419113 (14h23m4.790521681s) [upload=14795]: Uploading segments... Aug 8 00:02:30.275464303 (14h23m4.790566902s) [upload=14795]: Got next segment. Inline: true Aug 8 00:02:30.275470409 (14h23m4.790572986s) [upload=14795]: Waiting for error group managing segments... Aug 8 00:02:30.275541468 (14h23m4.790644064s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:02:30.275548435 (14h23m4.790651025s) [upload=14795]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:02:30.275553112 (14h23m4.790655694s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:02:30.437129275 (14h23m4.952231852s) [upload=14795]: Done uploading segments... Aug 8 00:02:30.437147837 (14h23m4.952250404s) [upload=14795]: Upload finished. err: <nil> Aug 8 00:03:02.216029168 (14h23m36.731131753s) [upload=14801]: Starting upload Aug 8 00:03:02.216131444 (14h23m36.731234024s) [upload=14801]: Done starting upload Aug 8 00:03:02.216223262 (14h23m36.731325836s) [upload=14801]: Uploading segments... Aug 8 00:03:02.216305099 (14h23m36.731407689s) [upload=14801]: Got next segment. Inline: true Aug 8 00:03:02.216311582 (14h23m36.731414165s) [upload=14801]: Waiting for error group managing segments... Aug 8 00:03:02.216381029 (14h23m36.731483612s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:02.216386785 (14h23m36.731489374s) [upload=14801]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:02.216390618 (14h23m36.731493197s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:02.283802345 (14h23m36.798904923s) [upload=14801]: Done uploading segments... Aug 8 00:03:02.283823305 (14h23m36.798925889s) [upload=14801]: Upload finished. err: <nil> Aug 8 00:03:30.509760483 (14h24m5.024863047s) [upload=14812]: Starting upload Aug 8 00:03:30.509815323 (14h24m5.024917908s) [upload=14812]: Done starting upload Aug 8 00:03:30.509926692 (14h24m5.02502927s) [upload=14812]: Uploading segments... Aug 8 00:03:30.509996173 (14h24m5.025098754s) [upload=14812]: Got next segment. Inline: true Aug 8 00:03:30.510002796 (14h24m5.025105377s) [upload=14812]: Waiting for error group managing segments... Aug 8 00:03:30.510068440 (14h24m5.025171017s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:30.510074098 (14h24m5.025176685s) [upload=14812]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:30.510077690 (14h24m5.025180273s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:30.698239096 (14h24m5.213341663s) [upload=14812]: Done uploading segments... Aug 8 00:03:30.698256740 (14h24m5.213359308s) [upload=14812]: Upload finished. err: <nil> Aug 8 00:04:41.065788390 (14h25m15.580890975s) [upload=14831]: Starting upload Aug 8 00:04:41.065849488 (14h25m15.580952064s) [upload=14831]: Done starting upload Aug 8 00:04:41.065914279 (14h25m15.581016856s) [upload=14831]: Uploading segments... Aug 8 00:04:41.065955528 (14h25m15.581058114s) [upload=14831]: Got next segment. Inline: true Aug 8 00:04:41.065961233 (14h25m15.581063813s) [upload=14831]: Waiting for error group managing segments... Aug 8 00:04:41.066010814 (14h25m15.581113395s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:41.066015217 (14h25m15.581117797s) [upload=14831]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:41.066019044 (14h25m15.581121626s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:41.143560517 (14h25m15.658663093s) [upload=14831]: Done uploading segments... Aug 8 00:04:41.143578273 (14h25m15.658680839s) [upload=14831]: Upload finished. err: <nil> Aug 8 00:04:57.174663208 (14h25m31.689765785s) [upload=14836]: Starting upload Aug 8 00:04:57.174738504 (14h25m31.68984108s) [upload=14836]: Done starting upload Aug 8 00:04:57.174818503 (14h25m31.689921072s) [upload=14836]: Uploading segments... Aug 8 00:04:57.174883379 (14h25m31.689985957s) [upload=14836]: Got next segment. Inline: true Aug 8 00:04:57.174888780 (14h25m31.689991347s) [upload=14836]: Waiting for error group managing segments... Aug 8 00:04:57.174955675 (14h25m31.690058262s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:57.174962095 (14h25m31.69006468s) [upload=14836]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:57.174966595 (14h25m31.690069178s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:57.317214071 (14h25m31.832316638s) [upload=14836]: Done uploading segments... Aug 8 00:04:57.317241163 (14h25m31.832343733s) [upload=14836]: Upload finished. err: <nil> Aug 8 00:06:06.741579891 (14h26m41.256682461s) [upload=14855]: Starting upload Aug 8 00:06:06.741694208 (14h26m41.256796791s) [upload=14855]: Done starting upload Aug 8 00:06:06.741776231 (14h26m41.256878801s) [upload=14855]: Uploading segments... Aug 8 00:06:06.741863808 (14h26m41.256966377s) [upload=14855]: Got next segment. Inline: true Aug 8 00:06:06.741870254 (14h26m41.25697283s) [upload=14855]: Waiting for error group managing segments... Aug 8 00:06:06.741939630 (14h26m41.257042211s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:06.741944620 (14h26m41.257047201s) [upload=14855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:06.741950358 (14h26m41.257052937s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:07.276784579 (14h26m41.791887173s) [upload=14855]: Done uploading segments... Aug 8 00:06:07.276805845 (14h26m41.79190841s) [upload=14855]: Upload finished. err: <nil> Aug 8 00:06:43.194994307 (14h27m17.710096878s) [upload=14865]: Starting upload Aug 8 00:06:43.195063177 (14h27m17.710165753s) [upload=14865]: Done starting upload Aug 8 00:06:43.195131851 (14h27m17.710234419s) [upload=14865]: Uploading segments... Aug 8 00:06:43.195200076 (14h27m17.710302661s) [upload=14865]: Got next segment. Inline: true Aug 8 00:06:43.195205915 (14h27m17.710308491s) [upload=14865]: Waiting for error group managing segments... Aug 8 00:06:43.195271114 (14h27m17.710373692s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:43.195276311 (14h27m17.710378889s) [upload=14865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:43.195279806 (14h27m17.710382383s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:43.430698626 (14h27m17.945801203s) [upload=14865]: Done uploading segments... Aug 8 00:06:43.430715582 (14h27m17.945818158s) [upload=14865]: Upload finished. err: <nil> Aug 8 00:07:00.838748208 (14h27m35.353850791s) [upload=14870]: Starting upload Aug 8 00:07:00.838831814 (14h27m35.353934397s) [upload=14870]: Done starting upload Aug 8 00:07:00.838944876 (14h27m35.354047439s) [upload=14870]: Uploading segments... Aug 8 00:07:00.839014925 (14h27m35.354117501s) [upload=14870]: Got next segment. Inline: true Aug 8 00:07:00.839045878 (14h27m35.354148457s) [upload=14870]: Waiting for error group managing segments... Aug 8 00:07:00.839120971 (14h27m35.354223549s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:07:00.839126346 (14h27m35.354228923s) [upload=14870]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:07:00.839129942 (14h27m35.354232518s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:07:00.932912415 (14h27m35.448014989s) [upload=14870]: Done uploading segments... Aug 8 00:07:00.932927726 (14h27m35.448030289s) [upload=14870]: Upload finished. err: <nil> Aug 8 00:08:14.384482900 (14h28m48.899585476s) [upload=14888]: Starting upload Aug 8 00:08:14.384593866 (14h28m48.899696446s) [upload=14888]: Done starting upload Aug 8 00:08:14.384673686 (14h28m48.899776254s) [upload=14888]: Uploading segments... Aug 8 00:08:14.384718832 (14h28m48.899821412s) [upload=14888]: Got next segment. Inline: true Aug 8 00:08:14.384723835 (14h28m48.899826412s) [upload=14888]: Waiting for error group managing segments... Aug 8 00:08:14.384763544 (14h28m48.89986612s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:08:14.384768731 (14h28m48.899871307s) [upload=14888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:08:14.384771994 (14h28m48.89987457s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:08:14.710769235 (14h28m49.225871818s) [upload=14888]: Done uploading segments... Aug 8 00:08:14.710803190 (14h28m49.225905767s) [upload=14888]: Upload finished. err: <nil> Aug 8 00:09:18.634609803 (14h29m53.149712376s) [upload=14909]: Starting upload Aug 8 00:09:18.634680614 (14h29m53.149783189s) [upload=14909]: Done starting upload Aug 8 00:09:18.634765976 (14h29m53.149868543s) [upload=14909]: Uploading segments... Aug 8 00:09:18.634815721 (14h29m53.1499183s) [upload=14909]: Got next segment. Inline: true Aug 8 00:09:18.634820719 (14h29m53.149923286s) [upload=14909]: Waiting for error group managing segments... Aug 8 00:09:18.634863856 (14h29m53.149966435s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:09:18.634868286 (14h29m53.149970863s) [upload=14909]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:09:18.634872291 (14h29m53.14997487s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:09:18.642683461 (14h29m53.157786047s) [upload=14909]: Done uploading segments... Aug 8 00:09:18.642703785 (14h29m53.157806368s) [upload=14909]: Upload finished. err: metaclient: Too Many Requests Duration: 334.048161ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 326.490142ms FAIL (2025-08-08 00:50:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== g segments... Aug 8 00:01:46.657245436 (14h22m21.172348015s) [upload=14780]: Upload finished. err: <nil> Aug 8 00:02:30.275266890 (14h23m4.790369467s) [upload=14795]: Starting upload Aug 8 00:02:30.275331708 (14h23m4.790434285s) [upload=14795]: Done starting upload Aug 8 00:02:30.275419113 (14h23m4.790521681s) [upload=14795]: Uploading segments... Aug 8 00:02:30.275464303 (14h23m4.790566902s) [upload=14795]: Got next segment. Inline: true Aug 8 00:02:30.275470409 (14h23m4.790572986s) [upload=14795]: Waiting for error group managing segments... Aug 8 00:02:30.275541468 (14h23m4.790644064s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:02:30.275548435 (14h23m4.790651025s) [upload=14795]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:02:30.275553112 (14h23m4.790655694s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:02:30.437129275 (14h23m4.952231852s) [upload=14795]: Done uploading segments... Aug 8 00:02:30.437147837 (14h23m4.952250404s) [upload=14795]: Upload finished. err: <nil> Aug 8 00:03:02.216029168 (14h23m36.731131753s) [upload=14801]: Starting upload Aug 8 00:03:02.216131444 (14h23m36.731234024s) [upload=14801]: Done starting upload Aug 8 00:03:02.216223262 (14h23m36.731325836s) [upload=14801]: Uploading segments... Aug 8 00:03:02.216305099 (14h23m36.731407689s) [upload=14801]: Got next segment. Inline: true Aug 8 00:03:02.216311582 (14h23m36.731414165s) [upload=14801]: Waiting for error group managing segments... Aug 8 00:03:02.216381029 (14h23m36.731483612s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:02.216386785 (14h23m36.731489374s) [upload=14801]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:02.216390618 (14h23m36.731493197s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:02.283802345 (14h23m36.798904923s) [upload=14801]: Done uploading segments... Aug 8 00:03:02.283823305 (14h23m36.798925889s) [upload=14801]: Upload finished. err: <nil> Aug 8 00:03:30.509760483 (14h24m5.024863047s) [upload=14812]: Starting upload Aug 8 00:03:30.509815323 (14h24m5.024917908s) [upload=14812]: Done starting upload Aug 8 00:03:30.509926692 (14h24m5.02502927s) [upload=14812]: Uploading segments... Aug 8 00:03:30.509996173 (14h24m5.025098754s) [upload=14812]: Got next segment. Inline: true Aug 8 00:03:30.510002796 (14h24m5.025105377s) [upload=14812]: Waiting for error group managing segments... Aug 8 00:03:30.510068440 (14h24m5.025171017s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:30.510074098 (14h24m5.025176685s) [upload=14812]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:30.510077690 (14h24m5.025180273s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:30.698239096 (14h24m5.213341663s) [upload=14812]: Done uploading segments... Aug 8 00:03:30.698256740 (14h24m5.213359308s) [upload=14812]: Upload finished. err: <nil> Aug 8 00:04:41.065788390 (14h25m15.580890975s) [upload=14831]: Starting upload Aug 8 00:04:41.065849488 (14h25m15.580952064s) [upload=14831]: Done starting upload Aug 8 00:04:41.065914279 (14h25m15.581016856s) [upload=14831]: Uploading segments... Aug 8 00:04:41.065955528 (14h25m15.581058114s) [upload=14831]: Got next segment. Inline: true Aug 8 00:04:41.065961233 (14h25m15.581063813s) [upload=14831]: Waiting for error group managing segments... Aug 8 00:04:41.066010814 (14h25m15.581113395s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:41.066015217 (14h25m15.581117797s) [upload=14831]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:41.066019044 (14h25m15.581121626s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:41.143560517 (14h25m15.658663093s) [upload=14831]: Done uploading segments... Aug 8 00:04:41.143578273 (14h25m15.658680839s) [upload=14831]: Upload finished. err: <nil> Aug 8 00:04:57.174663208 (14h25m31.689765785s) [upload=14836]: Starting upload Aug 8 00:04:57.174738504 (14h25m31.68984108s) [upload=14836]: Done starting upload Aug 8 00:04:57.174818503 (14h25m31.689921072s) [upload=14836]: Uploading segments... Aug 8 00:04:57.174883379 (14h25m31.689985957s) [upload=14836]: Got next segment. Inline: true Aug 8 00:04:57.174888780 (14h25m31.689991347s) [upload=14836]: Waiting for error group managing segments... Aug 8 00:04:57.174955675 (14h25m31.690058262s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:57.174962095 (14h25m31.69006468s) [upload=14836]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:57.174966595 (14h25m31.690069178s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:57.317214071 (14h25m31.832316638s) [upload=14836]: Done uploading segments... Aug 8 00:04:57.317241163 (14h25m31.832343733s) [upload=14836]: Upload finished. err: <nil> Aug 8 00:06:06.741579891 (14h26m41.256682461s) [upload=14855]: Starting upload Aug 8 00:06:06.741694208 (14h26m41.256796791s) [upload=14855]: Done starting upload Aug 8 00:06:06.741776231 (14h26m41.256878801s) [upload=14855]: Uploading segments... Aug 8 00:06:06.741863808 (14h26m41.256966377s) [upload=14855]: Got next segment. Inline: true Aug 8 00:06:06.741870254 (14h26m41.25697283s) [upload=14855]: Waiting for error group managing segments... Aug 8 00:06:06.741939630 (14h26m41.257042211s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:06.741944620 (14h26m41.257047201s) [upload=14855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:06.741950358 (14h26m41.257052937s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:07.276784579 (14h26m41.791887173s) [upload=14855]: Done uploading segments... Aug 8 00:06:07.276805845 (14h26m41.79190841s) [upload=14855]: Upload finished. err: <nil> Aug 8 00:06:43.194994307 (14h27m17.710096878s) [upload=14865]: Starting upload Aug 8 00:06:43.195063177 (14h27m17.710165753s) [upload=14865]: Done starting upload Aug 8 00:06:43.195131851 (14h27m17.710234419s) [upload=14865]: Uploading segments... Aug 8 00:06:43.195200076 (14h27m17.710302661s) [upload=14865]: Got next segment. Inline: true Aug 8 00:06:43.195205915 (14h27m17.710308491s) [upload=14865]: Waiting for error group managing segments... Aug 8 00:06:43.195271114 (14h27m17.710373692s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:43.195276311 (14h27m17.710378889s) [upload=14865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:43.195279806 (14h27m17.710382383s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:43.430698626 (14h27m17.945801203s) [upload=14865]: Done uploading segments... Aug 8 00:06:43.430715582 (14h27m17.945818158s) [upload=14865]: Upload finished. err: <nil> Aug 8 00:07:00.838748208 (14h27m35.353850791s) [upload=14870]: Starting upload Aug 8 00:07:00.838831814 (14h27m35.353934397s) [upload=14870]: Done starting upload Aug 8 00:07:00.838944876 (14h27m35.354047439s) [upload=14870]: Uploading segments... Aug 8 00:07:00.839014925 (14h27m35.354117501s) [upload=14870]: Got next segment. Inline: true Aug 8 00:07:00.839045878 (14h27m35.354148457s) [upload=14870]: Waiting for error group managing segments... Aug 8 00:07:00.839120971 (14h27m35.354223549s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:07:00.839126346 (14h27m35.354228923s) [upload=14870]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:07:00.839129942 (14h27m35.354232518s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:07:00.932912415 (14h27m35.448014989s) [upload=14870]: Done uploading segments... Aug 8 00:07:00.932927726 (14h27m35.448030289s) [upload=14870]: Upload finished. err: <nil> Aug 8 00:08:14.384482900 (14h28m48.899585476s) [upload=14888]: Starting upload Aug 8 00:08:14.384593866 (14h28m48.899696446s) [upload=14888]: Done starting upload Aug 8 00:08:14.384673686 (14h28m48.899776254s) [upload=14888]: Uploading segments... Aug 8 00:08:14.384718832 (14h28m48.899821412s) [upload=14888]: Got next segment. Inline: true Aug 8 00:08:14.384723835 (14h28m48.899826412s) [upload=14888]: Waiting for error group managing segments... Aug 8 00:08:14.384763544 (14h28m48.89986612s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:08:14.384768731 (14h28m48.899871307s) [upload=14888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:08:14.384771994 (14h28m48.89987457s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:08:14.710769235 (14h28m49.225871818s) [upload=14888]: Done uploading segments... Aug 8 00:08:14.710803190 (14h28m49.225905767s) [upload=14888]: Upload finished. err: <nil> Aug 8 00:09:18.634609803 (14h29m53.149712376s) [upload=14909]: Starting upload Aug 8 00:09:18.634680614 (14h29m53.149783189s) [upload=14909]: Done starting upload Aug 8 00:09:18.634765976 (14h29m53.149868543s) [upload=14909]: Uploading segments... Aug 8 00:09:18.634815721 (14h29m53.1499183s) [upload=14909]: Got next segment. Inline: true Aug 8 00:09:18.634820719 (14h29m53.149923286s) [upload=14909]: Waiting for error group managing segments... Aug 8 00:09:18.634863856 (14h29m53.149966435s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:09:18.634868286 (14h29m53.149970863s) [upload=14909]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:09:18.634872291 (14h29m53.14997487s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:09:18.642683461 (14h29m53.157786047s) [upload=14909]: Done uploading segments... Aug 8 00:09:18.642703785 (14h29m53.157806368s) [upload=14909]: Upload finished. err: metaclient: Too Many Requests Duration: 326.518125ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X......................X.................................] duration: 488.93694ms FAIL (2025-08-08 00:50:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ) [upload=15225]: Uploading segments... Aug 8 00:27:17.247676847 (14h47m51.762779424s) [upload=15225]: Got next segment. Inline: false Aug 8 00:27:17.247721996 (14h47m51.762824562s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:27:17.247727528 (14h47m51.762830101s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:27:17.291545729 (14h47m51.806648308s) [seg_pos={0 0}, upload=15225]: Begin upload segment... Aug 8 00:27:17.291590761 (14h47m51.806693337s) [seg_pos={0 0}, upload=15225]: Done begin upload segment. Aug 8 00:27:17.291631943 (14h47m51.806734519s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292350161 (14h47m51.807452747s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292862589 (14h47m51.807965158s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293356653 (14h47m51.80845923s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293694765 (14h47m51.80879733s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294102126 (14h47m51.809204705s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294457024 (14h47m51.809559649s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.295762993 (14h47m51.810865579s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.297221012 (14h47m51.812323592s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.298415523 (14h47m51.813518102s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299170586 (14h47m51.814273165s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299586634 (14h47m51.81468922s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300505377 (14h47m51.815607954s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300910486 (14h47m51.816013065s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.301313473 (14h47m51.816416052s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302240248 (14h47m51.817342831s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302660216 (14h47m51.817762801s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.303320933 (14h47m51.818423632s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.384020479 (14h47m51.899123063s) [upload=15225]: Next returned nil segment Aug 8 00:27:17.384038984 (14h47m51.89914157s) [upload=15225]: Waiting for error group managing segments... Aug 8 00:27:17.396462311 (14h47m51.911564953s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428089069 (14h47m51.943191637s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428197820 (14h47m51.943300395s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429065580 (14h47m51.94416816s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429798850 (14h47m51.944901413s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.430471949 (14h47m51.945574528s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.431184975 (14h47m51.946287543s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.446861505 (14h47m51.961964068s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.457827988 (14h47m51.97293057s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.526482208 (14h47m52.041584776s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.589478551 (14h47m52.10458112s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.619406819 (14h47m52.134509387s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.779336776 (14h47m52.294439354s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901796739 (14h47m52.416899309s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901837818 (14h47m52.416940395s) [seg_pos={0 0}, upload=15225]: Segment reached optimal threshold of 14 pieces. Aug 8 00:27:17.902063495 (14h47m52.417166078s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902253593 (14h47m52.417356165s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eSiwZPVoVzJ6RhkoWL1khLGbAgM743dPBxSTK6k8mNhxf79VH): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902332676 (14h47m52.417435243s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902546674 (14h47m52.417649253s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection Aug 8 00:27:17.902567693 (14h47m52.417670272s) [seg_pos={0 0}, upload=15225]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:27:17.902675722 (14h47m52.417778301s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:27:17.902682592 (14h47m52.41778517s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:27:17.996275903 (14h47m52.511378493s) [upload=15225]: Done uploading segments... Aug 8 00:27:17.996299184 (14h47m52.511401765s) [upload=15225]: Upload finished. err: <nil> Duration: 488.980568ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 206.071261ms FAIL (2025-08-08 00:49:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== g segments... Aug 8 00:01:46.657245436 (14h22m21.172348015s) [upload=14780]: Upload finished. err: <nil> Aug 8 00:02:30.275266890 (14h23m4.790369467s) [upload=14795]: Starting upload Aug 8 00:02:30.275331708 (14h23m4.790434285s) [upload=14795]: Done starting upload Aug 8 00:02:30.275419113 (14h23m4.790521681s) [upload=14795]: Uploading segments... Aug 8 00:02:30.275464303 (14h23m4.790566902s) [upload=14795]: Got next segment. Inline: true Aug 8 00:02:30.275470409 (14h23m4.790572986s) [upload=14795]: Waiting for error group managing segments... Aug 8 00:02:30.275541468 (14h23m4.790644064s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:02:30.275548435 (14h23m4.790651025s) [upload=14795]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:02:30.275553112 (14h23m4.790655694s) [upload=14795]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:02:30.437129275 (14h23m4.952231852s) [upload=14795]: Done uploading segments... Aug 8 00:02:30.437147837 (14h23m4.952250404s) [upload=14795]: Upload finished. err: <nil> Aug 8 00:03:02.216029168 (14h23m36.731131753s) [upload=14801]: Starting upload Aug 8 00:03:02.216131444 (14h23m36.731234024s) [upload=14801]: Done starting upload Aug 8 00:03:02.216223262 (14h23m36.731325836s) [upload=14801]: Uploading segments... Aug 8 00:03:02.216305099 (14h23m36.731407689s) [upload=14801]: Got next segment. Inline: true Aug 8 00:03:02.216311582 (14h23m36.731414165s) [upload=14801]: Waiting for error group managing segments... Aug 8 00:03:02.216381029 (14h23m36.731483612s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:02.216386785 (14h23m36.731489374s) [upload=14801]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:02.216390618 (14h23m36.731493197s) [upload=14801]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:02.283802345 (14h23m36.798904923s) [upload=14801]: Done uploading segments... Aug 8 00:03:02.283823305 (14h23m36.798925889s) [upload=14801]: Upload finished. err: <nil> Aug 8 00:03:30.509760483 (14h24m5.024863047s) [upload=14812]: Starting upload Aug 8 00:03:30.509815323 (14h24m5.024917908s) [upload=14812]: Done starting upload Aug 8 00:03:30.509926692 (14h24m5.02502927s) [upload=14812]: Uploading segments... Aug 8 00:03:30.509996173 (14h24m5.025098754s) [upload=14812]: Got next segment. Inline: true Aug 8 00:03:30.510002796 (14h24m5.025105377s) [upload=14812]: Waiting for error group managing segments... Aug 8 00:03:30.510068440 (14h24m5.025171017s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:03:30.510074098 (14h24m5.025176685s) [upload=14812]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:03:30.510077690 (14h24m5.025180273s) [upload=14812]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:03:30.698239096 (14h24m5.213341663s) [upload=14812]: Done uploading segments... Aug 8 00:03:30.698256740 (14h24m5.213359308s) [upload=14812]: Upload finished. err: <nil> Aug 8 00:04:41.065788390 (14h25m15.580890975s) [upload=14831]: Starting upload Aug 8 00:04:41.065849488 (14h25m15.580952064s) [upload=14831]: Done starting upload Aug 8 00:04:41.065914279 (14h25m15.581016856s) [upload=14831]: Uploading segments... Aug 8 00:04:41.065955528 (14h25m15.581058114s) [upload=14831]: Got next segment. Inline: true Aug 8 00:04:41.065961233 (14h25m15.581063813s) [upload=14831]: Waiting for error group managing segments... Aug 8 00:04:41.066010814 (14h25m15.581113395s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:41.066015217 (14h25m15.581117797s) [upload=14831]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:41.066019044 (14h25m15.581121626s) [upload=14831]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:41.143560517 (14h25m15.658663093s) [upload=14831]: Done uploading segments... Aug 8 00:04:41.143578273 (14h25m15.658680839s) [upload=14831]: Upload finished. err: <nil> Aug 8 00:04:57.174663208 (14h25m31.689765785s) [upload=14836]: Starting upload Aug 8 00:04:57.174738504 (14h25m31.68984108s) [upload=14836]: Done starting upload Aug 8 00:04:57.174818503 (14h25m31.689921072s) [upload=14836]: Uploading segments... Aug 8 00:04:57.174883379 (14h25m31.689985957s) [upload=14836]: Got next segment. Inline: true Aug 8 00:04:57.174888780 (14h25m31.689991347s) [upload=14836]: Waiting for error group managing segments... Aug 8 00:04:57.174955675 (14h25m31.690058262s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:04:57.174962095 (14h25m31.69006468s) [upload=14836]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:04:57.174966595 (14h25m31.690069178s) [upload=14836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:04:57.317214071 (14h25m31.832316638s) [upload=14836]: Done uploading segments... Aug 8 00:04:57.317241163 (14h25m31.832343733s) [upload=14836]: Upload finished. err: <nil> Aug 8 00:06:06.741579891 (14h26m41.256682461s) [upload=14855]: Starting upload Aug 8 00:06:06.741694208 (14h26m41.256796791s) [upload=14855]: Done starting upload Aug 8 00:06:06.741776231 (14h26m41.256878801s) [upload=14855]: Uploading segments... Aug 8 00:06:06.741863808 (14h26m41.256966377s) [upload=14855]: Got next segment. Inline: true Aug 8 00:06:06.741870254 (14h26m41.25697283s) [upload=14855]: Waiting for error group managing segments... Aug 8 00:06:06.741939630 (14h26m41.257042211s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:06.741944620 (14h26m41.257047201s) [upload=14855]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:06.741950358 (14h26m41.257052937s) [upload=14855]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:07.276784579 (14h26m41.791887173s) [upload=14855]: Done uploading segments... Aug 8 00:06:07.276805845 (14h26m41.79190841s) [upload=14855]: Upload finished. err: <nil> Aug 8 00:06:43.194994307 (14h27m17.710096878s) [upload=14865]: Starting upload Aug 8 00:06:43.195063177 (14h27m17.710165753s) [upload=14865]: Done starting upload Aug 8 00:06:43.195131851 (14h27m17.710234419s) [upload=14865]: Uploading segments... Aug 8 00:06:43.195200076 (14h27m17.710302661s) [upload=14865]: Got next segment. Inline: true Aug 8 00:06:43.195205915 (14h27m17.710308491s) [upload=14865]: Waiting for error group managing segments... Aug 8 00:06:43.195271114 (14h27m17.710373692s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:06:43.195276311 (14h27m17.710378889s) [upload=14865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:06:43.195279806 (14h27m17.710382383s) [upload=14865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:06:43.430698626 (14h27m17.945801203s) [upload=14865]: Done uploading segments... Aug 8 00:06:43.430715582 (14h27m17.945818158s) [upload=14865]: Upload finished. err: <nil> Aug 8 00:07:00.838748208 (14h27m35.353850791s) [upload=14870]: Starting upload Aug 8 00:07:00.838831814 (14h27m35.353934397s) [upload=14870]: Done starting upload Aug 8 00:07:00.838944876 (14h27m35.354047439s) [upload=14870]: Uploading segments... Aug 8 00:07:00.839014925 (14h27m35.354117501s) [upload=14870]: Got next segment. Inline: true Aug 8 00:07:00.839045878 (14h27m35.354148457s) [upload=14870]: Waiting for error group managing segments... Aug 8 00:07:00.839120971 (14h27m35.354223549s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:07:00.839126346 (14h27m35.354228923s) [upload=14870]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:07:00.839129942 (14h27m35.354232518s) [upload=14870]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:07:00.932912415 (14h27m35.448014989s) [upload=14870]: Done uploading segments... Aug 8 00:07:00.932927726 (14h27m35.448030289s) [upload=14870]: Upload finished. err: <nil> Aug 8 00:08:14.384482900 (14h28m48.899585476s) [upload=14888]: Starting upload Aug 8 00:08:14.384593866 (14h28m48.899696446s) [upload=14888]: Done starting upload Aug 8 00:08:14.384673686 (14h28m48.899776254s) [upload=14888]: Uploading segments... Aug 8 00:08:14.384718832 (14h28m48.899821412s) [upload=14888]: Got next segment. Inline: true Aug 8 00:08:14.384723835 (14h28m48.899826412s) [upload=14888]: Waiting for error group managing segments... Aug 8 00:08:14.384763544 (14h28m48.89986612s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:08:14.384768731 (14h28m48.899871307s) [upload=14888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:08:14.384771994 (14h28m48.89987457s) [upload=14888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:08:14.710769235 (14h28m49.225871818s) [upload=14888]: Done uploading segments... Aug 8 00:08:14.710803190 (14h28m49.225905767s) [upload=14888]: Upload finished. err: <nil> Aug 8 00:09:18.634609803 (14h29m53.149712376s) [upload=14909]: Starting upload Aug 8 00:09:18.634680614 (14h29m53.149783189s) [upload=14909]: Done starting upload Aug 8 00:09:18.634765976 (14h29m53.149868543s) [upload=14909]: Uploading segments... Aug 8 00:09:18.634815721 (14h29m53.1499183s) [upload=14909]: Got next segment. Inline: true Aug 8 00:09:18.634820719 (14h29m53.149923286s) [upload=14909]: Waiting for error group managing segments... Aug 8 00:09:18.634863856 (14h29m53.149966435s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:09:18.634868286 (14h29m53.149970863s) [upload=14909]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 00:09:18.634872291 (14h29m53.14997487s) [upload=14909]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:09:18.642683461 (14h29m53.157786047s) [upload=14909]: Done uploading segments... Aug 8 00:09:18.642703785 (14h29m53.157806368s) [upload=14909]: Upload finished. err: metaclient: Too Many Requests Duration: 206.096658ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X......................X................................] duration: 507.710796ms FAIL (2025-08-08 00:49:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ) [upload=15225]: Uploading segments... Aug 8 00:27:17.247676847 (14h47m51.762779424s) [upload=15225]: Got next segment. Inline: false Aug 8 00:27:17.247721996 (14h47m51.762824562s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 00:27:17.247727528 (14h47m51.762830101s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 00:27:17.291545729 (14h47m51.806648308s) [seg_pos={0 0}, upload=15225]: Begin upload segment... Aug 8 00:27:17.291590761 (14h47m51.806693337s) [seg_pos={0 0}, upload=15225]: Done begin upload segment. Aug 8 00:27:17.291631943 (14h47m51.806734519s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292350161 (14h47m51.807452747s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.292862589 (14h47m51.807965158s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293356653 (14h47m51.80845923s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.293694765 (14h47m51.80879733s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294102126 (14h47m51.809204705s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.294457024 (14h47m51.809559649s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.295762993 (14h47m51.810865579s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.297221012 (14h47m51.812323592s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.298415523 (14h47m51.813518102s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299170586 (14h47m51.814273165s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.299586634 (14h47m51.81468922s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300505377 (14h47m51.815607954s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.300910486 (14h47m51.816013065s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.301313473 (14h47m51.816416052s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302240248 (14h47m51.817342831s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.302660216 (14h47m51.817762801s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.303320933 (14h47m51.818423632s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Uploading piece... Aug 8 00:27:17.384020479 (14h47m51.899123063s) [upload=15225]: Next returned nil segment Aug 8 00:27:17.384038984 (14h47m51.89914157s) [upload=15225]: Waiting for error group managing segments... Aug 8 00:27:17.396462311 (14h47m51.911564953s) [noise=true , address=104.36.82.46:4513 , piece_id=7T3TMIOGN76YWORXT5X66QMQOV24IY4NZQG7SMWXHLUHFQABVNOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428089069 (14h47m51.943191637s) [noise=true , address=45.91.116.11:4141 , piece_id=WOL3MJQYL2SGX2TJG4RMOEDKGMYY5RD2YMVZG5QUBBEFVGJGNMTQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.428197820 (14h47m51.943300395s) [noise=true , address=45.91.116.7:4038 , piece_id=RUEEQN5ZHTZKIQO5OXL4NS5PWN25LDPF4TY6IC4QTTZMH47KXDLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429065580 (14h47m51.94416816s) [noise=true , address=45.91.116.5:4300 , piece_id=XXDA7T7QHO2VECVTSR52W3QOT4FEGAIWVTNR6RPECKJORTIS3NLA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.429798850 (14h47m51.944901413s) [noise=true , address=104.36.82.43:4861 , piece_id=2BBS3GTKG4EQXZRNEXUQ4JL3R6DR6K4BLRJGPCUOAM4IXLXEF6BA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.430471949 (14h47m51.945574528s) [noise=true , address=104.36.82.34:4579 , piece_id=KA3A5QUKHL4P3TMVVTPTCWGJPCH7ERN6DMWBVJ6KWMKIDN53ICWQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.431184975 (14h47m51.946287543s) [noise=true , address=104.36.82.54:4172 , piece_id=4RT6QVUU5WCVBUCFBJQ4FAZJUA7LPAFGK6VPWMRPHUPJGYUCMMTA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.446861505 (14h47m51.961964068s) [noise=true , address=104.36.82.16:4320 , piece_id=QWOGMKISCMZC5H7DSMM2F35WAZZ3TK5E36XVOWII373CFLGH2TZA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.457827988 (14h47m51.97293057s) [noise=true , address=104.36.82.23:4451 , piece_id=LSCKHQOPYSLONCMEK27U24YV3UBUVJI6F4WNCDYK23C5BHIHPHWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.526482208 (14h47m52.041584776s) [noise=true , address=104.36.82.37:4664 , piece_id=MYROXIKVJWGAKTZY6WB64U4KTMVGRIDZYT47WI2QQBK24GJLFJOQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.589478551 (14h47m52.10458112s) [noise=true , address=104.36.82.47:4528 , piece_id=LSSSUPLH2WV6C4TYDZYGB2GEZXXM62L3XTNQR4HHZQXV3B2T4HIA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.619406819 (14h47m52.134509387s) [noise=true , address=104.36.82.8:4001 , piece_id=223UBVNUUOZ256X26NJFDEKUTBTN3JLH2RYZDFSEKIVNL5VPQNFA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.779336776 (14h47m52.294439354s) [noise=true , address=104.36.82.61:4400 , piece_id=LRVKARPNWZNJ56WMLXF5DBN2QK5WB3IF25DEQ3ELXQP46NFCNT3A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901796739 (14h47m52.416899309s) [noise=true , address=79.127.205.234:4593 , piece_id=APYUXRS5JSLSJZR2TSL5SXOAIHZ3TJM3IJOSEDFHUHTJHABRC35Q, seg_pos={0 0}, upload=15225]: Done uploading piece. err: <nil> Aug 8 00:27:17.901837818 (14h47m52.416940395s) [seg_pos={0 0}, upload=15225]: Segment reached optimal threshold of 14 pieces. Aug 8 00:27:17.902063495 (14h47m52.417166078s) [noise=true , address=64.49.13.138:4485 , piece_id=D4T6FZNVR3PV3AT5JDK7VPISREA424KJYHXNUJ4NAXMC3QUMQZ5A, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Jw25xoDRqePr6VBUBLYmMvzN52nM5E6zgf4xLDztWuPRwZAUM): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902253593 (14h47m52.417356165s) [noise=true , address=64.49.13.139:4472 , piece_id=OQ44H75QA5YNZ47C5GNNBVYCNOX3CSDFYJBVLDVXOIAPEAB55WQQ, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eSiwZPVoVzJ6RhkoWL1khLGbAgM743dPBxSTK6k8mNhxf79VH): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902332676 (14h47m52.417435243s) [noise=true , address=193.149.164.143:4698 , piece_id=JDWQ4MSQCIZ2XM7V5LCVQHOOTBEDBHZXIQ4YWCDHB2MYHLQ6KAWA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12F4fJAGJM2ZPRt7vJH2cZmEbYeujmxcfi7aPZ2g9VPTNYBYRAi): protocol: expected piece hash; context canceled; EOF Aug 8 00:27:17.902546674 (14h47m52.417649253s) [noise=true , address=104.36.82.60:4361 , piece_id=LHSMZIB64A4WFW2FCRPZINQ7KEFXDR2ZBTLYOFX72XT4KL4VCVSA, seg_pos={0 0}, upload=15225]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:41834->104.36.82.60:4361: use of closed network connection Aug 8 00:27:17.902567693 (14h47m52.417670272s) [seg_pos={0 0}, upload=15225]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 00:27:17.902675722 (14h47m52.417778301s) [upload=15225]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 00:27:17.902682592 (14h47m52.41778517s) [upload=15225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 00:27:17.996275903 (14h47m52.511378493s) [upload=15225]: Done uploading segments... Aug 8 00:27:17.996299184 (14h47m52.511401765s) [upload=15225]: Upload finished. err: <nil> Duration: 507.738795ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)