Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
653.071766ms
FAIL (2025-08-07 12:22:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 653.140862ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
233.066581ms
FAIL (2025-08-07 12:21:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 233.092981ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
227.099349ms
FAIL (2025-08-07 12:21:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 227.132484ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
450.608443ms
FAIL (2025-08-07 12:21:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 450.637052ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
231.345434ms
FAIL (2025-08-07 12:20:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 231.400782ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
471.638242ms
FAIL (2025-08-07 12:20:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 471.668575ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
740.626693ms
FAIL (2025-08-07 12:19:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 740.65533ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
286.882632ms
FAIL (2025-08-07 12:19:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 286.908358ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
481.189037ms
FAIL (2025-08-07 12:18:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 481.217734ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
205.870758ms
FAIL (2025-08-07 12:18:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 205.906784ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
561.511382ms
FAIL (2025-08-07 12:18:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 561.547368ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
240.598593ms
FAIL (2025-08-07 12:18:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 240.642573ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
211.86629ms
FAIL (2025-08-07 12:17:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 211.898636ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
465.060939ms
FAIL (2025-08-07 12:16:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 465.089621ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
245.695337ms
FAIL (2025-08-07 12:16:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 245.722024ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
726.264772ms
FAIL (2025-08-07 12:15:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 726.298358ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
441.846796ms
FAIL (2025-08-07 12:15:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 441.881919ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
519.44756ms
FAIL (2025-08-07 12:14:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 519.471717ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
183.628491ms
FAIL (2025-08-07 12:14:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 183.659621ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
659.314495ms
FAIL (2025-08-07 12:14:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 659.340502ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
232.79725ms
FAIL (2025-08-07 12:14:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 232.839416ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
590.953329ms
FAIL (2025-08-07 12:13:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 590.978034ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
230.241995ms
FAIL (2025-08-07 12:13:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 230.290572ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
68.875068ms
FAIL (2025-08-07 12:13:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== line Aug 7 12:05:14.884790735 (2h25m49.399893311s) [upload=2545]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:15.194484157 (2h25m49.709586735s) [upload=2545]: Done uploading segments... Aug 7 12:05:15.194505033 (2h25m49.709607609s) [upload=2545]: Upload finished. err: <nil> Aug 7 12:05:45.790558845 (2h26m20.305661424s) [upload=2552]: Starting upload Aug 7 12:05:45.790614601 (2h26m20.305717177s) [upload=2552]: Done starting upload Aug 7 12:05:45.790711618 (2h26m20.305814195s) [upload=2552]: Uploading segments... Aug 7 12:05:45.790774426 (2h26m20.305877015s) [upload=2552]: Got next segment. Inline: true Aug 7 12:05:45.790782190 (2h26m20.305884781s) [upload=2552]: Waiting for error group managing segments... Aug 7 12:05:45.790841557 (2h26m20.305944134s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:05:45.790863384 (2h26m20.305965979s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:05:45.790868122 (2h26m20.305970703s) [upload=2552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:05:45.980820597 (2h26m20.49592327s) [upload=2552]: Done uploading segments... Aug 7 12:05:45.980845958 (2h26m20.49594854s) [upload=2552]: Upload finished. err: <nil> Aug 7 12:06:37.801214844 (2h27m12.316317427s) [upload=2566]: Starting upload Aug 7 12:06:37.801271236 (2h27m12.316373813s) [upload=2566]: Done starting upload Aug 7 12:06:37.801373562 (2h27m12.31647614s) [upload=2566]: Uploading segments... Aug 7 12:06:37.801551304 (2h27m12.316653889s) [upload=2566]: Got next segment. Inline: true Aug 7 12:06:37.801561278 (2h27m12.316663861s) [upload=2566]: Waiting for error group managing segments... Aug 7 12:06:37.801631153 (2h27m12.316733733s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:06:37.801636298 (2h27m12.316738878s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:06:37.801639402 (2h27m12.316741979s) [upload=2566]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:06:38.029483525 (2h27m12.544586124s) [upload=2566]: Done uploading segments... Aug 7 12:06:38.029504311 (2h27m12.544606903s) [upload=2566]: Upload finished. err: <nil> Aug 7 12:07:49.749471964 (2h28m24.264574527s) [upload=2588]: Starting upload Aug 7 12:07:49.749539280 (2h28m24.264641843s) [upload=2588]: Done starting upload Aug 7 12:07:49.749620975 (2h28m24.264723539s) [upload=2588]: Uploading segments... Aug 7 12:07:49.749665327 (2h28m24.264767916s) [upload=2588]: Got next segment. Inline: true Aug 7 12:07:49.749671303 (2h28m24.264773892s) [upload=2588]: Waiting for error group managing segments... Aug 7 12:07:49.749736641 (2h28m24.26483922s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:07:49.749741717 (2h28m24.264844294s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:07:49.749745091 (2h28m24.264847668s) [upload=2588]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:07:49.846073307 (2h28m24.361175899s) [upload=2588]: Done uploading segments... Aug 7 12:07:49.846093973 (2h28m24.361196539s) [upload=2588]: Upload finished. err: <nil> Aug 7 12:09:03.333992630 (2h29m37.84909522s) [upload=2609]: Starting upload Aug 7 12:09:03.334069236 (2h29m37.84917182s) [upload=2609]: Done starting upload Aug 7 12:09:03.334167915 (2h29m37.849270486s) [upload=2609]: Uploading segments... Aug 7 12:09:03.334228528 (2h29m37.849331118s) [upload=2609]: Got next segment. Inline: true Aug 7 12:09:03.334234893 (2h29m37.849337479s) [upload=2609]: Waiting for error group managing segments... Aug 7 12:09:03.334298501 (2h29m37.849401093s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:03.334304084 (2h29m37.849406675s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:03.334307926 (2h29m37.849410514s) [upload=2609]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:03.418804822 (2h29m37.933907389s) [upload=2609]: Done uploading segments... Aug 7 12:09:03.418828565 (2h29m37.93393114s) [upload=2609]: Upload finished. err: <nil> Aug 7 12:09:24.180535636 (2h29m58.695638212s) [upload=2613]: Starting upload Aug 7 12:09:24.180612949 (2h29m58.695715517s) [upload=2613]: Done starting upload Aug 7 12:09:24.180705063 (2h29m58.695807632s) [upload=2613]: Uploading segments... Aug 7 12:09:24.180792397 (2h29m58.695894995s) [upload=2613]: Got next segment. Inline: true Aug 7 12:09:24.180815038 (2h29m58.695917615s) [upload=2613]: Waiting for error group managing segments... Aug 7 12:09:24.180893996 (2h29m58.695996574s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:09:24.180898748 (2h29m58.696001317s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:09:24.180902097 (2h29m58.696004673s) [upload=2613]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:09:24.248229168 (2h29m58.76333175s) [upload=2613]: Done uploading segments... Aug 7 12:09:24.248257013 (2h29m58.763359588s) [upload=2613]: Upload finished. err: <nil> Aug 7 12:10:29.564038610 (2h31m4.079141177s) [upload=2628]: Starting upload Aug 7 12:10:29.564129533 (2h31m4.079232113s) [upload=2628]: Done starting upload Aug 7 12:10:29.564208306 (2h31m4.079310873s) [upload=2628]: Uploading segments... Aug 7 12:10:29.564257671 (2h31m4.079360255s) [upload=2628]: Got next segment. Inline: true Aug 7 12:10:29.564262690 (2h31m4.079365265s) [upload=2628]: Waiting for error group managing segments... Aug 7 12:10:29.564316809 (2h31m4.079419377s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:29.564323119 (2h31m4.079425696s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:29.564328126 (2h31m4.07943071s) [upload=2628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:29.646980235 (2h31m4.162082818s) [upload=2628]: Done uploading segments... Aug 7 12:10:29.646999823 (2h31m4.16210241s) [upload=2628]: Upload finished. err: <nil> Aug 7 12:10:49.983065710 (2h31m24.498168298s) [upload=2636]: Starting upload Aug 7 12:10:49.983117785 (2h31m24.498220372s) [upload=2636]: Done starting upload Aug 7 12:10:49.983250696 (2h31m24.498353258s) [upload=2636]: Uploading segments... Aug 7 12:10:49.983313852 (2h31m24.498416433s) [upload=2636]: Got next segment. Inline: true Aug 7 12:10:49.983321276 (2h31m24.498423857s) [upload=2636]: Waiting for error group managing segments... Aug 7 12:10:49.983370270 (2h31m24.498472851s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:10:49.983390506 (2h31m24.498493085s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:10:49.983394411 (2h31m24.498496992s) [upload=2636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:10:50.092414079 (2h31m24.60751666s) [upload=2636]: Done uploading segments... Aug 7 12:10:50.092438284 (2h31m24.607540862s) [upload=2636]: Upload finished. err: <nil> Aug 7 12:11:08.840887820 (2h31m43.355990386s) [upload=2643]: Starting upload Aug 7 12:11:08.840953476 (2h31m43.356056061s) [upload=2643]: Done starting upload Aug 7 12:11:08.841040515 (2h31m43.356143092s) [upload=2643]: Uploading segments... Aug 7 12:11:08.841097420 (2h31m43.356200002s) [upload=2643]: Got next segment. Inline: true Aug 7 12:11:08.841102808 (2h31m43.356205377s) [upload=2643]: Waiting for error group managing segments... Aug 7 12:11:08.841166615 (2h31m43.356269192s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:11:08.841171787 (2h31m43.356274354s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:11:08.841174981 (2h31m43.356277548s) [upload=2643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:11:08.919580649 (2h31m43.434683225s) [upload=2643]: Done uploading segments... Aug 7 12:11:08.919598377 (2h31m43.434700954s) [upload=2643]: Upload finished. err: <nil> Aug 7 12:12:15.167694678 (2h32m49.682797245s) [upload=2662]: Starting upload Aug 7 12:12:15.167759924 (2h32m49.682862492s) [upload=2662]: Done starting upload Aug 7 12:12:15.167985205 (2h32m49.683087775s) [upload=2662]: Uploading segments... Aug 7 12:12:15.168063669 (2h32m49.683166255s) [upload=2662]: Got next segment. Inline: true Aug 7 12:12:15.168070660 (2h32m49.683173244s) [upload=2662]: Waiting for error group managing segments... Aug 7 12:12:15.168130688 (2h32m49.683233272s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:12:15.168137125 (2h32m49.683239721s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:12:15.168140935 (2h32m49.683243516s) [upload=2662]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:12:15.362690435 (2h32m49.877793023s) [upload=2662]: Done uploading segments... Aug 7 12:12:15.362713773 (2h32m49.877816354s) [upload=2662]: Upload finished. err: <nil> Aug 7 12:13:12.366014044 (2h33m46.881116623s) [upload=2678]: Starting upload Aug 7 12:13:12.366126283 (2h33m46.881228858s) [upload=2678]: Done starting upload Aug 7 12:13:12.366269129 (2h33m46.881371714s) [upload=2678]: Uploading segments... Aug 7 12:13:12.366358188 (2h33m46.88146077s) [upload=2678]: Got next segment. Inline: true Aug 7 12:13:12.366364445 (2h33m46.881467028s) [upload=2678]: Waiting for error group managing segments... Aug 7 12:13:12.366434497 (2h33m46.881537083s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 7 12:13:12.366444131 (2h33m46.881546699s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:12.366448590 (2h33m46.881551155s) [upload=2678]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 7 12:13:12.405263489 (2h33m46.920366073s) [upload=2678]: Done uploading segments... Aug 7 12:13:12.405282879 (2h33m46.920385457s) [upload=2678]: Upload finished. err: metaclient: Too Many Requests
Duration: 68.896519ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.751347658s
FAIL (2025-08-07 12:12:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 1.751378887s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
448.510482ms
FAIL (2025-08-07 12:11:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 448.541881ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
999.28488ms
FAIL (2025-08-07 12:11:18 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 999.311523ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
921.997752ms
FAIL (2025-08-07 12:10:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 922.023574ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
654.294677ms
FAIL (2025-08-07 12:09:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 654.322825ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
507.740349ms
FAIL (2025-08-07 12:08:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 507.768561ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
637.197174ms
FAIL (2025-08-07 12:07:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 637.223052ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
479.962795ms
FAIL (2025-08-07 12:06:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 480.007764ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
798.999463ms
FAIL (2025-08-07 12:06:05 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 799.047859ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
735.42324ms
FAIL (2025-08-07 12:04:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 735.466473ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
698.234413ms
FAIL (2025-08-07 12:03:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 698.276625ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
483.043926ms
FAIL (2025-08-07 12:03:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 483.073602ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
681.880292ms
FAIL (2025-08-07 12:01:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 681.929471ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
491.160511ms
FAIL (2025-08-07 12:00:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 491.197209ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
606.128861ms
FAIL (2025-08-07 11:59:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 606.16106ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
505.887639ms
FAIL (2025-08-07 11:58:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 505.919743ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
490.717923ms
FAIL (2025-08-07 11:58:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 490.745435ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
460.616339ms
FAIL (2025-08-07 11:57:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 460.645345ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
509.812978ms
FAIL (2025-08-07 11:57:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 509.843025ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
447.583862ms
FAIL (2025-08-07 11:55:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 447.614036ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.037278993s
FAIL (2025-08-07 11:55:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 1.037433206s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
656.033794ms
FAIL (2025-08-07 11:54:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 656.06221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
598.962865ms
FAIL (2025-08-07 11:53:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 598.993225ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
535.516731ms
FAIL (2025-08-07 11:52:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 535.539407ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
462.512411ms
FAIL (2025-08-07 11:51:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 462.539229ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
553.626938ms
FAIL (2025-08-07 11:51:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
=2205]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:45:37.954855273 (2h6m12.469957852s) [upload=2205]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:45:38.019669333 (2h6m12.534771901s) [upload=2205]: Done uploading segments...
Aug 7 11:45:38.019687276 (2h6m12.534789849s) [upload=2205]: Upload finished. err: <nil>
Aug 7 11:46:14.579519681 (2h6m49.094622257s) [upload=2215]: Starting upload
Aug 7 11:46:14.579591124 (2h6m49.094693701s) [upload=2215]: Done starting upload
Aug 7 11:46:14.579738634 (2h6m49.09484121s) [upload=2215]: Uploading segments...
Aug 7 11:46:14.580114382 (2h6m49.095216958s) [upload=2215]: Got next segment. Inline: false
Aug 7 11:46:14.580278739 (2h6m49.095381316s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 7 11:46:14.580284049 (2h6m49.095386626s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 7 11:46:14.628827210 (2h6m49.143929781s) [seg_pos={0 0}, upload=2215]: Begin upload segment...
Aug 7 11:46:14.628883837 (2h6m49.143986406s) [seg_pos={0 0}, upload=2215]: Done begin upload segment.
Aug 7 11:46:14.628931123 (2h6m49.144033704s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.628942383 (2h6m49.144044961s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629326773 (2h6m49.144429352s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629382100 (2h6m49.14448468s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629628649 (2h6m49.144731228s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629721726 (2h6m49.144824296s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.629941114 (2h6m49.145043695s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630256566 (2h6m49.145359146s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630556299 (2h6m49.145658875s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.630855402 (2h6m49.145957987s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631195249 (2h6m49.146297828s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631525181 (2h6m49.146627763s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631790877 (2h6m49.146893445s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.631845175 (2h6m49.146947754s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632240979 (2h6m49.147343554s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632558743 (2h6m49.147661324s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632697449 (2h6m49.147800043s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.632963180 (2h6m49.148065758s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Uploading piece...
Aug 7 11:46:14.740094824 (2h6m49.255197394s) [upload=2215]: Next returned nil segment
Aug 7 11:46:14.740240525 (2h6m49.255343102s) [upload=2215]: Waiting for error group managing segments...
Aug 7 11:46:14.747549031 (2h6m49.262651598s) [noise=true , address=45.91.116.9:4286 , piece_id=CO6GBZUNXE5AWQIQEFXWCOCRRDSNP5AE7RXHNTTXVMQ5U3ZNUWNA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.750891914 (2h6m49.265994483s) [noise=true , address=45.91.116.7:4017 , piece_id=W2BW5Q6X2WGIFTSMW7KPEXFNNEO27IIG7RTES6TUIYCW4VQE2BOA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.751480291 (2h6m49.26658286s) [noise=true , address=104.36.82.37:4666 , piece_id=HLQNK7ZVFYTRTZ5TLQDCUJ4J5MREH6WGH5R7RK5RZ4NBC5HPYJCQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.752998087 (2h6m49.268100649s) [noise=true , address=104.36.82.46:4498 , piece_id=EAM3AKCTCUXQEXO7OPCKZUZ574FIW4BUCB5NE65WMBDSQPNRM3PA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.753400019 (2h6m49.268502589s) [noise=true , address=104.36.82.16:4314 , piece_id=UYH6I76MRZIJLLFWEFI7VN6ERC7MKXJI6WRMQF4ZFEQEKTYOMFAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.754839512 (2h6m49.26994209s) [noise=true , address=104.36.82.58:4277 , piece_id=RL6UAO6UKKAYRSI4MHULGSXBVCVOXL5PMSZBXWVBHVOEZ6IDBQSA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759182803 (2h6m49.274285492s) [noise=true , address=104.36.82.23:4445 , piece_id=646TTDJYDQYMTSB6PKLZK6V6GN3MDWPT2RF4M5HWZNBFAKBW3ABA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.759897408 (2h6m49.274999982s) [noise=true , address=45.91.116.5:4323 , piece_id=HUKGO35FHWPQ6OZDVXN6OGEKBCRPEYWNBQFHFURRXDDPMILF6PDA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760562109 (2h6m49.275664672s) [noise=true , address=45.91.116.13:4163 , piece_id=MQVSRSAVAVD4UDJJKCJN6Y6PEDY3P36TLLVN62EGNE5TOPNN2ZAQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.760931946 (2h6m49.276034523s) [noise=true , address=104.36.82.13:4210 , piece_id=HIATLJMTEES3OE7IZDNHAOV6E2KYI37CCAKALEB6TLJLT6ACTOFA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.763546309 (2h6m49.278648878s) [noise=true , address=104.36.82.14:4246 , piece_id=KZAKFZG7VYP6CNPBGBG6W5J36EYG6CSRBSEK4DKVC6J3INSKZ2MA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.767418894 (2h6m49.282521463s) [noise=true , address=104.36.82.61:4380 , piece_id=TFLYDTWKQUBG26DVJ4DCGLZ7YO2TR6BIRIMB5SQ4ILHX4MFHDRRA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769402343 (2h6m49.28450492s) [noise=true , address=104.36.82.43:4847 , piece_id=PPONWPXSV2UFFY6QA35OCIN3NFASXOKBG74ZDZUG6HE723P62HBA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769870722 (2h6m49.284973299s) [noise=true , address=104.36.82.54:4159 , piece_id=IBSLD4NLVPRKY2PUXDVSMM33KVQGICVOHFHJPFUWQ5KLITUQDVNQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.769887056 (2h6m49.284989633s) [seg_pos={0 0}, upload=2215]: Segment reached optimal threshold of 14 pieces.
Aug 7 11:46:14.770028921 (2h6m49.285131494s) [noise=true , address=104.36.82.62:4430 , piece_id=Z3TRAVCMLS23ZSJU62MNTZNTB7X6HHZ2S34FN55AD4MONDGIJVPA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15fmq7zLwrSHRmwJ4eai2bXDnCsAqUEhqCLHqHvMuf189v9sQb): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770130341 (2h6m49.285232905s) [noise=true , address=104.36.82.47:4535 , piece_id=AYIKT27OXZLE5PNM2TA3ZBDHLCWXUOXJODHZ3AVSHL5KUSJ3RQPQ, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KFwCcqBCTyeBBQYzg6SFG4YDzBm2H9s4D2JRvnC31VAGvpLhu): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770225300 (2h6m49.285327878s) [noise=true , address=104.36.82.10:4081 , piece_id=KKS627L23VOBQK6TMRLRQC3JKWSOBID4W3GQVKV3JD3NWV7WGEGA, seg_pos={0 0}, upload=2215]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t9rGfCQ7bLkNnZzaPVgkE2Y9rXsiFp1XGdeECzv9M1jk8Qqmp): protocol: expected piece hash; context canceled; EOF
Aug 7 11:46:14.770297099 (2h6m49.285399668s) [noise=true , address=104.36.82.44:4893 , piece_id=ODJIHCMR6P7U5F4VO5CDMUNK7BUTA7TG54OTN334EBBHWOG4GO5Q, seg_pos={0 0}, upload=2215]: Done uploading piece. err: <nil>
Aug 7 11:46:14.770316777 (2h6m49.285419354s) [seg_pos={0 0}, upload=2215]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil>
Aug 7 11:46:14.770377022 (2h6m49.285479598s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 7 11:46:14.770381655 (2h6m49.28548423s) [upload=2215]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 7 11:46:14.882509206 (2h6m49.397611786s) [upload=2215]: Done uploading segments...
Aug 7 11:46:14.882533339 (2h6m49.397635919s) [upload=2215]: Upload finished. err: <nil>
Duration: 553.844913ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|