Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.88736283s FAIL (2025-08-07 11:50:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== =2205]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments... Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil> Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments... Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment... Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment. Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments... Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces. Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments... Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil> Duration: 1.887412982s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 474.97483ms FAIL (2025-08-07 11:49:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== =2205]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments... Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil> Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments... Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment... Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment. Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments... Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces. Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments... Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil> Duration: 475.00673ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 515.093742ms FAIL (2025-08-07 11:49:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== =2205]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments... Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil> Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments... Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment... Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment. Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments... Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces. Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments... Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil> Duration: 515.119451ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 476.398452ms FAIL (2025-08-07 11:48:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== =2205]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments... Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil> Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments... Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment... Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment. Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments... Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces. Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments... Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil> Duration: 476.441761ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 469.976933ms FAIL (2025-08-07 11:47:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== =2205]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments... Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil> Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments... Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment... Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment. Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments... Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces. Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments... Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil> Duration: 470.00466ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.334087848s FAIL (2025-08-07 11:47:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== =2205]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments... Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil> Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments... Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment... Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment. Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments... Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces. Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments... Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil> Duration: 1.334116268s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 555.177404ms FAIL (2025-08-07 11:46:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== =2205]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments... Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil> Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments... Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment... Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment. Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece... Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments... Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces. Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil> Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments... Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil> Duration: 555.20608ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 1.051908142s FAIL (2025-08-07 10:40:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 1.05193703s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 648.217538ms FAIL (2025-08-07 10:39:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 648.24282ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 578.766394ms FAIL (2025-08-07 10:38:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 578.800758ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 597.44292ms FAIL (2025-08-07 10:37:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 597.471287ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 457.944714ms FAIL (2025-08-07 10:37:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 457.973683ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 533.970158ms FAIL (2025-08-07 10:36:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 533.999758ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 639.408113ms FAIL (2025-08-07 10:35:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 639.448051ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 570.471253ms FAIL (2025-08-07 10:34:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 570.504562ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 467.772961ms FAIL (2025-08-07 10:33:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 467.801273ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 643.261296ms FAIL (2025-08-07 10:32:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 643.292665ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 615.659827ms FAIL (2025-08-07 10:32:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 615.686332ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 588.000321ms FAIL (2025-08-07 10:31:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 588.034232ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 566.134972ms FAIL (2025-08-07 10:30:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 566.165506ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 696.723337ms FAIL (2025-08-07 10:29:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 696.744776ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.106824215s FAIL (2025-08-07 10:28:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 1.106852444s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 593.475717ms FAIL (2025-08-07 10:27:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 593.528711ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 732.63124ms FAIL (2025-08-07 10:26:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 732.661375ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 964.532765ms FAIL (2025-08-07 10:26:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 964.578252ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 1.000450167s FAIL (2025-08-07 10:25:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 1.000475594s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 1.753548358s FAIL (2025-08-07 10:25:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 1.753576778s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 706.895643ms FAIL (2025-08-07 10:23:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 706.921197ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 663.010917ms FAIL (2025-08-07 10:23:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 663.036369ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 637.146674ms FAIL (2025-08-07 10:22:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 637.17691ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 545.462286ms FAIL (2025-08-07 10:21:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 545.499847ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 519.508433ms FAIL (2025-08-07 10:21:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 519.54176ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 541.180103ms FAIL (2025-08-07 10:20:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 541.20948ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 518.95797ms FAIL (2025-08-07 10:19:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 518.984565ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 922.963098ms FAIL (2025-08-07 10:18:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 922.984549ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 575.607072ms FAIL (2025-08-07 10:18:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 575.635392ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 490.1798ms FAIL (2025-08-07 10:18:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 490.208855ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 601.893294ms FAIL (2025-08-07 10:17:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 601.938989ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 513.891311ms FAIL (2025-08-07 10:17:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 513.915717ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 404.650482ms FAIL (2025-08-07 10:16:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 404.69097ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 493.930762ms FAIL (2025-08-07 10:15:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 493.957406ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 523.387454ms FAIL (2025-08-07 10:14:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 523.4119ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 440.190427ms FAIL (2025-08-07 10:13:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 440.22412ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 465.096177ms FAIL (2025-08-07 10:13:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 465.125026ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 552.196548ms FAIL (2025-08-07 10:12:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 552.225639ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 488.164503ms FAIL (2025-08-07 10:11:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 488.190554ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 646.8565ms FAIL (2025-08-07 10:10:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 646.912786ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 623.554067ms FAIL (2025-08-07 10:10:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 623.594831ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 509.903915ms FAIL (2025-08-07 10:09:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 509.950479ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 447.188146ms FAIL (2025-08-07 10:08:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== upload segment... Aug 7 09:56:34.239653204 (17m8.754755793s) [seg_pos={0 0}, upload=290]: Done begin upload segment. Aug 7 09:56:34.239686271 (17m8.754788858s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.239746347 (17m8.754848933s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240193311 (17m8.755295897s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240431281 (17m8.755533869s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240660336 (17m8.755762922s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.240974216 (17m8.7560768s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241057764 (17m8.756160347s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241428134 (17m8.756530721s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241459832 (17m8.756562422s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241843238 (17m8.756945833s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.241960029 (17m8.757062616s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242225896 (17m8.757328483s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242439136 (17m8.757541723s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242583883 (17m8.757686469s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.242953985 (17m8.758056575s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243052614 (17m8.758155198s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243474377 (17m8.758576966s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.243928436 (17m8.759031027s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Uploading piece... Aug 7 09:56:34.351423687 (17m8.866526255s) [upload=290]: Next returned nil segment Aug 7 09:56:34.351439507 (17m8.866542083s) [upload=290]: Waiting for error group managing segments... Aug 7 09:56:34.357034921 (17m8.872137491s) [noise=true , address=45.91.116.14:4194 , piece_id=SNIE7ITTKLSFYHCIXC47PRVPA455LA3H6J2ZDESM7OKUR7JD3V4Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.363358898 (17m8.878461468s) [noise=true , address=104.36.82.14:4236 , piece_id=BPW4ZL25XZYHDFIZ767LMKHDFM7AF3UEW7TZC5EGSLY7OIQOKMCA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364012571 (17m8.879115134s) [noise=true , address=104.36.82.17:4341 , piece_id=LMAZX25HWG77RI3HZBL4XBWIMKWB2WQJBTACPN65F2NQDGKUB42Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.364655562 (17m8.879758131s) [noise=true , address=104.36.82.43:4836 , piece_id=W755QLMNLEX3H7234G7NHQ2TYRXDMG7LS6X4BEZL63D7UUT2DDNA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.365115016 (17m8.880217585s) [noise=true , address=104.36.82.23:4465 , piece_id=YEYR77OKWRJMYZHEBPBAF2DVTMTHXLEWGBILHT7PXVY4SR2RFO6Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.369421392 (17m8.884523958s) [noise=true , address=104.36.82.47:4543 , piece_id=YHZYNKQ5TNV3UBHWG6X6ZOPZXOFEEAGCWRXJDDNVZ2JWXDOHIAHA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371256570 (17m8.886359133s) [noise=true , address=104.36.82.5:4867 , piece_id=PZ7HAFR35S3X6GGV53ZSBTN5WN6LD27OC7VKCXTFXGZ6XCYMEFPA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371899716 (17m8.887002294s) [noise=true , address=104.36.82.60:4362 , piece_id=AEXCBGDOE5JKBA73CDWQJSTOARJASTYGTV6GN2MDVDT26U4YIUVQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.371940770 (17m8.887043346s) [noise=true , address=104.36.82.16:4311 , piece_id=YSWEVNBVOOCXOCDBYIQJ7NYC2YJXQCSC6A53FTD2S4E5WXYQ2U5Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.373451164 (17m8.888553754s) [noise=true , address=104.36.82.61:4401 , piece_id=XJSXE736IQFQNEF7G2R6PXQOJBSRQYZJGKEFF3FMNXCDFP3Q3N3Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.374790200 (17m8.88989277s) [noise=true , address=104.36.82.9:4009 , piece_id=A5F7NRMVDBMP3LDQHZZ7JCTJPC2LYSJDMH6MSKIBNDPWGSHFV56A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375420249 (17m8.890522816s) [noise=true , address=104.36.82.62:4425 , piece_id=QS2CBME77UHFXQ6AYXZ7QS2MUNZAW6XTJZLOX2H66JKEFECE3YIA, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.375784645 (17m8.890887213s) [noise=true , address=104.36.82.46:4513 , piece_id=IRF7FF6UBFQLZ5MW5YCV6OOAZSZBLIVXKOLA4LVJSJ7HHITKSTOQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378543990 (17m8.893646558s) [noise=true , address=45.91.116.5:4317 , piece_id=KFM3TYM4FTF27VHZD2DXAZUYDELP6IHYFQ5GWJHIYXAODGMBBV2A, seg_pos={0 0}, upload=290]: Done uploading piece. err: <nil> Aug 7 09:56:34.378565730 (17m8.893668306s) [seg_pos={0 0}, upload=290]: Segment reached optimal threshold of 14 pieces. Aug 7 09:56:34.378707902 (17m8.893810488s) [noise=true , address=104.36.82.44:4894 , piece_id=LECMEJ4AUT4MH6B4BHQF2QNSVPXUQSMOW3LQRBZ3OYLPPJKV45QQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KWNyruYhmSJVvgUF7fBpGf4H7eYmtAeEXToYjd2dcEPcj1E44): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.378914202 (17m8.894016769s) [noise=true , address=104.36.82.36:4634 , piece_id=SW3W5HW2ZI7E2DOR4EDZ7HJGWWWJOQQD3H3N5OQG7OF3AJLG4AEQ, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kwydp3q2wTrCVadJZB7WmKGK8h2R5QL7HGpUsjTpRbcnWUSb5): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379092826 (17m8.894195402s) [noise=true , address=104.36.82.54:4181 , piece_id=SSO5I5QI57ZE6LR3KJQQIP3DCUUZWYXWQCMUZ7WDISUWD6WQ6JVA, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gGf5E7tzF2TXtLWgpK55t24SC1BpTSeC9G66nPmR1ARnDrAE8): protocol: expected piece hash; context canceled; EOF Aug 7 09:56:34.379322021 (17m8.894424602s) [noise=true , address=64.49.13.140:4509 , piece_id=37CTL4S35KS6TYGSZNMZLZL53XPZ2CWHYFDMHLRR37LPZ6AZ7F2Q, seg_pos={0 0}, upload=290]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aAChC1wJq5xDtfBhkBT6UdwoWy5TNwFK3etPKmSkQJr8Fz51P): protocol: read tcp 159.223.143.39:45046->64.49.13.140:4509: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 09:56:34.379352778 (17m8.894455405s) [seg_pos={0 0}, upload=290]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 09:56:34.379422797 (17m8.894525394s) [upload=290]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 09:56:34.379427345 (17m8.894529921s) [upload=290]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 09:56:34.434562255 (17m8.949664841s) [upload=290]: Done uploading segments... Aug 7 09:56:34.434599762 (17m8.949702345s) [upload=290]: Upload finished. err: <nil> Aug 7 09:56:57.363150007 (17m31.878252584s) [upload=295]: Starting upload Aug 7 09:56:57.363204947 (17m31.878307536s) [upload=295]: Done starting upload Aug 7 09:56:57.363486610 (17m31.878589172s) [upload=295]: Uploading segments... Aug 7 09:56:57.363520059 (17m31.878622644s) [upload=295]: Got next segment. Inline: false Aug 7 09:56:57.363550184 (17m31.878652746s) [upload=295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 09:56:57.363553574 (17m31.878656151s) [upload=295]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 09:56:57.405066452 (17m31.920169038s) [upload=295]: Next segment err: metaclient: Too Many Requests Aug 7 09:56:57.405091150 (17m31.920193738s) [upload=295]: Done uploading segments... Aug 7 09:56:57.405108424 (17m31.920210995s) [upload=295]: Upload finished. err: metaclient: Too Many Requests Duration: 447.232039ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)