Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 183.777815ms FAIL (2025-08-08 10:28:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 8 10:16:24.996444595 (24h36m59.511547171s) [upload=25489]: Upload finished. err: <nil> Aug 8 10:16:40.086056336 (24h37m14.601158902s) [upload=25494]: Starting upload Aug 8 10:16:40.086138218 (24h37m14.601240816s) [upload=25494]: Done starting upload Aug 8 10:16:40.086246239 (24h37m14.601348806s) [upload=25494]: Uploading segments... Aug 8 10:16:40.086322136 (24h37m14.601424723s) [upload=25494]: Got next segment. Inline: true Aug 8 10:16:40.086329274 (24h37m14.601431857s) [upload=25494]: Waiting for error group managing segments... Aug 8 10:16:40.086406338 (24h37m14.601508921s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:16:40.086412709 (24h37m14.601515298s) [upload=25494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:16:40.086433433 (24h37m14.601536015s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:16:40.147707180 (24h37m14.66280976s) [upload=25494]: Done uploading segments... Aug 8 10:16:40.147727908 (24h37m14.662830485s) [upload=25494]: Upload finished. err: <nil> Aug 8 10:17:33.679048155 (24h38m8.194150731s) [upload=25512]: Starting upload Aug 8 10:17:33.679106608 (24h38m8.194209187s) [upload=25512]: Done starting upload Aug 8 10:17:33.679160905 (24h38m8.194263481s) [upload=25512]: Uploading segments... Aug 8 10:17:33.679237763 (24h38m8.194340367s) [upload=25512]: Got next segment. Inline: true Aug 8 10:17:33.679243473 (24h38m8.194346036s) [upload=25512]: Waiting for error group managing segments... Aug 8 10:17:33.679305479 (24h38m8.194408056s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:17:33.679310678 (24h38m8.194413245s) [upload=25512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:17:33.679313670 (24h38m8.194416232s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:17:33.743363385 (24h38m8.258465953s) [upload=25512]: Done uploading segments... Aug 8 10:17:33.743382354 (24h38m8.258484924s) [upload=25512]: Upload finished. err: <nil> Aug 8 10:18:09.841643530 (24h38m44.356746109s) [upload=25524]: Starting upload Aug 8 10:18:09.841707253 (24h38m44.356809822s) [upload=25524]: Done starting upload Aug 8 10:18:09.841782697 (24h38m44.35688526s) [upload=25524]: Uploading segments... Aug 8 10:18:09.841827030 (24h38m44.356929615s) [upload=25524]: Got next segment. Inline: true Aug 8 10:18:09.841845384 (24h38m44.356947962s) [upload=25524]: Waiting for error group managing segments... Aug 8 10:18:09.841892035 (24h38m44.356994612s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:18:09.841901651 (24h38m44.357004228s) [upload=25524]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:18:09.841905159 (24h38m44.357007736s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:18:09.905896485 (24h38m44.420999051s) [upload=25524]: Done uploading segments... Aug 8 10:18:09.905913027 (24h38m44.421015593s) [upload=25524]: Upload finished. err: <nil> Aug 8 10:19:23.131461453 (24h39m57.646564033s) [upload=25542]: Starting upload Aug 8 10:19:23.131505897 (24h39m57.646608483s) [upload=25542]: Done starting upload Aug 8 10:19:23.131586149 (24h39m57.646688715s) [upload=25542]: Uploading segments... Aug 8 10:19:23.131649692 (24h39m57.646752277s) [upload=25542]: Got next segment. Inline: true Aug 8 10:19:23.131655195 (24h39m57.646757771s) [upload=25542]: Waiting for error group managing segments... Aug 8 10:19:23.131714698 (24h39m57.646817274s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:23.131719532 (24h39m57.646822109s) [upload=25542]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:23.131722759 (24h39m57.646825336s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:23.206304231 (24h39m57.721406802s) [upload=25542]: Done uploading segments... Aug 8 10:19:23.206326930 (24h39m57.721429497s) [upload=25542]: Upload finished. err: <nil> Aug 8 10:19:54.392300720 (24h40m28.907403287s) [upload=25548]: Starting upload Aug 8 10:19:54.392349163 (24h40m28.907451742s) [upload=25548]: Done starting upload Aug 8 10:19:54.392419702 (24h40m28.907522272s) [upload=25548]: Uploading segments... Aug 8 10:19:54.392455430 (24h40m28.907558015s) [upload=25548]: Got next segment. Inline: true Aug 8 10:19:54.392460240 (24h40m28.907562806s) [upload=25548]: Waiting for error group managing segments... Aug 8 10:19:54.392508955 (24h40m28.907611521s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:54.392513704 (24h40m28.907616283s) [upload=25548]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:54.392516750 (24h40m28.907619315s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:54.607175596 (24h40m29.122278175s) [upload=25548]: Done uploading segments... Aug 8 10:19:54.607193769 (24h40m29.122296335s) [upload=25548]: Upload finished. err: <nil> Aug 8 10:21:05.692737556 (24h41m40.207840123s) [upload=25567]: Starting upload Aug 8 10:21:05.692815089 (24h41m40.207917657s) [upload=25567]: Done starting upload Aug 8 10:21:05.692894948 (24h41m40.207997514s) [upload=25567]: Uploading segments... Aug 8 10:21:05.692944055 (24h41m40.208046641s) [upload=25567]: Got next segment. Inline: true Aug 8 10:21:05.692950912 (24h41m40.208053489s) [upload=25567]: Waiting for error group managing segments... Aug 8 10:21:05.692998236 (24h41m40.208100823s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:05.693004179 (24h41m40.20810676s) [upload=25567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:05.693007287 (24h41m40.208109867s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:05.757359800 (24h41m40.272462386s) [upload=25567]: Done uploading segments... Aug 8 10:21:05.757383050 (24h41m40.272485626s) [upload=25567]: Upload finished. err: <nil> Aug 8 10:21:53.504743996 (24h42m28.019846582s) [upload=25582]: Starting upload Aug 8 10:21:53.504817681 (24h42m28.019920261s) [upload=25582]: Done starting upload Aug 8 10:21:53.504908346 (24h42m28.020010928s) [upload=25582]: Uploading segments... Aug 8 10:21:53.504956252 (24h42m28.020058836s) [upload=25582]: Got next segment. Inline: true Aug 8 10:21:53.504962939 (24h42m28.020065516s) [upload=25582]: Waiting for error group managing segments... Aug 8 10:21:53.505014143 (24h42m28.020116729s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:53.505020195 (24h42m28.020122779s) [upload=25582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:53.505024975 (24h42m28.020127552s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:53.567859466 (24h42m28.082962043s) [upload=25582]: Done uploading segments... Aug 8 10:21:53.567875292 (24h42m28.082977868s) [upload=25582]: Upload finished. err: <nil> Aug 8 10:22:57.956939547 (24h43m32.472042133s) [upload=25598]: Starting upload Aug 8 10:22:57.956995820 (24h43m32.472098408s) [upload=25598]: Done starting upload Aug 8 10:22:57.957240080 (24h43m32.472342648s) [upload=25598]: Uploading segments... Aug 8 10:22:57.957311205 (24h43m32.472413791s) [upload=25598]: Got next segment. Inline: true Aug 8 10:22:57.957317746 (24h43m32.472420323s) [upload=25598]: Waiting for error group managing segments... Aug 8 10:22:57.957385033 (24h43m32.472487614s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:22:57.957390668 (24h43m32.472493246s) [upload=25598]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:22:57.957394180 (24h43m32.472496757s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:22:58.029812590 (24h43m32.544915169s) [upload=25598]: Done uploading segments... Aug 8 10:22:58.029834230 (24h43m32.544936798s) [upload=25598]: Upload finished. err: <nil> Aug 8 10:23:18.816059986 (24h43m53.331162571s) [upload=25604]: Starting upload Aug 8 10:23:18.816111932 (24h43m53.331214508s) [upload=25604]: Done starting upload Aug 8 10:23:18.816172180 (24h43m53.331274751s) [upload=25604]: Uploading segments... Aug 8 10:23:18.816210063 (24h43m53.331312649s) [upload=25604]: Got next segment. Inline: true Aug 8 10:23:18.816214426 (24h43m53.331316991s) [upload=25604]: Waiting for error group managing segments... Aug 8 10:23:18.816251408 (24h43m53.331353974s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:23:18.816255697 (24h43m53.331358273s) [upload=25604]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:23:18.816258801 (24h43m53.331361371s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:23:19.087130277 (24h43m53.602232846s) [upload=25604]: Done uploading segments... Aug 8 10:23:19.087151214 (24h43m53.602253781s) [upload=25604]: Upload finished. err: <nil> Aug 8 10:24:21.030100948 (24h44m55.545203519s) [upload=25623]: Starting upload Aug 8 10:24:21.030162897 (24h44m55.545265478s) [upload=25623]: Done starting upload Aug 8 10:24:21.030247890 (24h44m55.545350466s) [upload=25623]: Uploading segments... Aug 8 10:24:21.030299798 (24h44m55.545402387s) [upload=25623]: Got next segment. Inline: true Aug 8 10:24:21.030306830 (24h44m55.545409394s) [upload=25623]: Waiting for error group managing segments... Aug 8 10:24:21.030431847 (24h44m55.545534414s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:24:21.030438082 (24h44m55.545540659s) [upload=25623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:24:21.030441385 (24h44m55.545543966s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:24:21.039318112 (24h44m55.554420681s) [upload=25623]: Done uploading segments... Aug 8 10:24:21.039334812 (24h44m55.554437379s) [upload=25623]: Upload finished. err: metaclient: Too Many Requests Duration: 183.814846ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 197.576217ms FAIL (2025-08-08 10:28:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 8 10:16:24.996444595 (24h36m59.511547171s) [upload=25489]: Upload finished. err: <nil> Aug 8 10:16:40.086056336 (24h37m14.601158902s) [upload=25494]: Starting upload Aug 8 10:16:40.086138218 (24h37m14.601240816s) [upload=25494]: Done starting upload Aug 8 10:16:40.086246239 (24h37m14.601348806s) [upload=25494]: Uploading segments... Aug 8 10:16:40.086322136 (24h37m14.601424723s) [upload=25494]: Got next segment. Inline: true Aug 8 10:16:40.086329274 (24h37m14.601431857s) [upload=25494]: Waiting for error group managing segments... Aug 8 10:16:40.086406338 (24h37m14.601508921s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:16:40.086412709 (24h37m14.601515298s) [upload=25494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:16:40.086433433 (24h37m14.601536015s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:16:40.147707180 (24h37m14.66280976s) [upload=25494]: Done uploading segments... Aug 8 10:16:40.147727908 (24h37m14.662830485s) [upload=25494]: Upload finished. err: <nil> Aug 8 10:17:33.679048155 (24h38m8.194150731s) [upload=25512]: Starting upload Aug 8 10:17:33.679106608 (24h38m8.194209187s) [upload=25512]: Done starting upload Aug 8 10:17:33.679160905 (24h38m8.194263481s) [upload=25512]: Uploading segments... Aug 8 10:17:33.679237763 (24h38m8.194340367s) [upload=25512]: Got next segment. Inline: true Aug 8 10:17:33.679243473 (24h38m8.194346036s) [upload=25512]: Waiting for error group managing segments... Aug 8 10:17:33.679305479 (24h38m8.194408056s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:17:33.679310678 (24h38m8.194413245s) [upload=25512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:17:33.679313670 (24h38m8.194416232s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:17:33.743363385 (24h38m8.258465953s) [upload=25512]: Done uploading segments... Aug 8 10:17:33.743382354 (24h38m8.258484924s) [upload=25512]: Upload finished. err: <nil> Aug 8 10:18:09.841643530 (24h38m44.356746109s) [upload=25524]: Starting upload Aug 8 10:18:09.841707253 (24h38m44.356809822s) [upload=25524]: Done starting upload Aug 8 10:18:09.841782697 (24h38m44.35688526s) [upload=25524]: Uploading segments... Aug 8 10:18:09.841827030 (24h38m44.356929615s) [upload=25524]: Got next segment. Inline: true Aug 8 10:18:09.841845384 (24h38m44.356947962s) [upload=25524]: Waiting for error group managing segments... Aug 8 10:18:09.841892035 (24h38m44.356994612s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:18:09.841901651 (24h38m44.357004228s) [upload=25524]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:18:09.841905159 (24h38m44.357007736s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:18:09.905896485 (24h38m44.420999051s) [upload=25524]: Done uploading segments... Aug 8 10:18:09.905913027 (24h38m44.421015593s) [upload=25524]: Upload finished. err: <nil> Aug 8 10:19:23.131461453 (24h39m57.646564033s) [upload=25542]: Starting upload Aug 8 10:19:23.131505897 (24h39m57.646608483s) [upload=25542]: Done starting upload Aug 8 10:19:23.131586149 (24h39m57.646688715s) [upload=25542]: Uploading segments... Aug 8 10:19:23.131649692 (24h39m57.646752277s) [upload=25542]: Got next segment. Inline: true Aug 8 10:19:23.131655195 (24h39m57.646757771s) [upload=25542]: Waiting for error group managing segments... Aug 8 10:19:23.131714698 (24h39m57.646817274s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:23.131719532 (24h39m57.646822109s) [upload=25542]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:23.131722759 (24h39m57.646825336s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:23.206304231 (24h39m57.721406802s) [upload=25542]: Done uploading segments... Aug 8 10:19:23.206326930 (24h39m57.721429497s) [upload=25542]: Upload finished. err: <nil> Aug 8 10:19:54.392300720 (24h40m28.907403287s) [upload=25548]: Starting upload Aug 8 10:19:54.392349163 (24h40m28.907451742s) [upload=25548]: Done starting upload Aug 8 10:19:54.392419702 (24h40m28.907522272s) [upload=25548]: Uploading segments... Aug 8 10:19:54.392455430 (24h40m28.907558015s) [upload=25548]: Got next segment. Inline: true Aug 8 10:19:54.392460240 (24h40m28.907562806s) [upload=25548]: Waiting for error group managing segments... Aug 8 10:19:54.392508955 (24h40m28.907611521s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:54.392513704 (24h40m28.907616283s) [upload=25548]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:54.392516750 (24h40m28.907619315s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:54.607175596 (24h40m29.122278175s) [upload=25548]: Done uploading segments... Aug 8 10:19:54.607193769 (24h40m29.122296335s) [upload=25548]: Upload finished. err: <nil> Aug 8 10:21:05.692737556 (24h41m40.207840123s) [upload=25567]: Starting upload Aug 8 10:21:05.692815089 (24h41m40.207917657s) [upload=25567]: Done starting upload Aug 8 10:21:05.692894948 (24h41m40.207997514s) [upload=25567]: Uploading segments... Aug 8 10:21:05.692944055 (24h41m40.208046641s) [upload=25567]: Got next segment. Inline: true Aug 8 10:21:05.692950912 (24h41m40.208053489s) [upload=25567]: Waiting for error group managing segments... Aug 8 10:21:05.692998236 (24h41m40.208100823s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:05.693004179 (24h41m40.20810676s) [upload=25567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:05.693007287 (24h41m40.208109867s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:05.757359800 (24h41m40.272462386s) [upload=25567]: Done uploading segments... Aug 8 10:21:05.757383050 (24h41m40.272485626s) [upload=25567]: Upload finished. err: <nil> Aug 8 10:21:53.504743996 (24h42m28.019846582s) [upload=25582]: Starting upload Aug 8 10:21:53.504817681 (24h42m28.019920261s) [upload=25582]: Done starting upload Aug 8 10:21:53.504908346 (24h42m28.020010928s) [upload=25582]: Uploading segments... Aug 8 10:21:53.504956252 (24h42m28.020058836s) [upload=25582]: Got next segment. Inline: true Aug 8 10:21:53.504962939 (24h42m28.020065516s) [upload=25582]: Waiting for error group managing segments... Aug 8 10:21:53.505014143 (24h42m28.020116729s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:53.505020195 (24h42m28.020122779s) [upload=25582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:53.505024975 (24h42m28.020127552s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:53.567859466 (24h42m28.082962043s) [upload=25582]: Done uploading segments... Aug 8 10:21:53.567875292 (24h42m28.082977868s) [upload=25582]: Upload finished. err: <nil> Aug 8 10:22:57.956939547 (24h43m32.472042133s) [upload=25598]: Starting upload Aug 8 10:22:57.956995820 (24h43m32.472098408s) [upload=25598]: Done starting upload Aug 8 10:22:57.957240080 (24h43m32.472342648s) [upload=25598]: Uploading segments... Aug 8 10:22:57.957311205 (24h43m32.472413791s) [upload=25598]: Got next segment. Inline: true Aug 8 10:22:57.957317746 (24h43m32.472420323s) [upload=25598]: Waiting for error group managing segments... Aug 8 10:22:57.957385033 (24h43m32.472487614s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:22:57.957390668 (24h43m32.472493246s) [upload=25598]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:22:57.957394180 (24h43m32.472496757s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:22:58.029812590 (24h43m32.544915169s) [upload=25598]: Done uploading segments... Aug 8 10:22:58.029834230 (24h43m32.544936798s) [upload=25598]: Upload finished. err: <nil> Aug 8 10:23:18.816059986 (24h43m53.331162571s) [upload=25604]: Starting upload Aug 8 10:23:18.816111932 (24h43m53.331214508s) [upload=25604]: Done starting upload Aug 8 10:23:18.816172180 (24h43m53.331274751s) [upload=25604]: Uploading segments... Aug 8 10:23:18.816210063 (24h43m53.331312649s) [upload=25604]: Got next segment. Inline: true Aug 8 10:23:18.816214426 (24h43m53.331316991s) [upload=25604]: Waiting for error group managing segments... Aug 8 10:23:18.816251408 (24h43m53.331353974s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:23:18.816255697 (24h43m53.331358273s) [upload=25604]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:23:18.816258801 (24h43m53.331361371s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:23:19.087130277 (24h43m53.602232846s) [upload=25604]: Done uploading segments... Aug 8 10:23:19.087151214 (24h43m53.602253781s) [upload=25604]: Upload finished. err: <nil> Aug 8 10:24:21.030100948 (24h44m55.545203519s) [upload=25623]: Starting upload Aug 8 10:24:21.030162897 (24h44m55.545265478s) [upload=25623]: Done starting upload Aug 8 10:24:21.030247890 (24h44m55.545350466s) [upload=25623]: Uploading segments... Aug 8 10:24:21.030299798 (24h44m55.545402387s) [upload=25623]: Got next segment. Inline: true Aug 8 10:24:21.030306830 (24h44m55.545409394s) [upload=25623]: Waiting for error group managing segments... Aug 8 10:24:21.030431847 (24h44m55.545534414s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:24:21.030438082 (24h44m55.545540659s) [upload=25623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:24:21.030441385 (24h44m55.545543966s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:24:21.039318112 (24h44m55.554420681s) [upload=25623]: Done uploading segments... Aug 8 10:24:21.039334812 (24h44m55.554437379s) [upload=25623]: Upload finished. err: metaclient: Too Many Requests Duration: 197.604513ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 448.338298ms FAIL (2025-08-08 10:28:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 448.364139ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 191.085236ms FAIL (2025-08-08 10:27:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 8 10:16:24.996444595 (24h36m59.511547171s) [upload=25489]: Upload finished. err: <nil> Aug 8 10:16:40.086056336 (24h37m14.601158902s) [upload=25494]: Starting upload Aug 8 10:16:40.086138218 (24h37m14.601240816s) [upload=25494]: Done starting upload Aug 8 10:16:40.086246239 (24h37m14.601348806s) [upload=25494]: Uploading segments... Aug 8 10:16:40.086322136 (24h37m14.601424723s) [upload=25494]: Got next segment. Inline: true Aug 8 10:16:40.086329274 (24h37m14.601431857s) [upload=25494]: Waiting for error group managing segments... Aug 8 10:16:40.086406338 (24h37m14.601508921s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:16:40.086412709 (24h37m14.601515298s) [upload=25494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:16:40.086433433 (24h37m14.601536015s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:16:40.147707180 (24h37m14.66280976s) [upload=25494]: Done uploading segments... Aug 8 10:16:40.147727908 (24h37m14.662830485s) [upload=25494]: Upload finished. err: <nil> Aug 8 10:17:33.679048155 (24h38m8.194150731s) [upload=25512]: Starting upload Aug 8 10:17:33.679106608 (24h38m8.194209187s) [upload=25512]: Done starting upload Aug 8 10:17:33.679160905 (24h38m8.194263481s) [upload=25512]: Uploading segments... Aug 8 10:17:33.679237763 (24h38m8.194340367s) [upload=25512]: Got next segment. Inline: true Aug 8 10:17:33.679243473 (24h38m8.194346036s) [upload=25512]: Waiting for error group managing segments... Aug 8 10:17:33.679305479 (24h38m8.194408056s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:17:33.679310678 (24h38m8.194413245s) [upload=25512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:17:33.679313670 (24h38m8.194416232s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:17:33.743363385 (24h38m8.258465953s) [upload=25512]: Done uploading segments... Aug 8 10:17:33.743382354 (24h38m8.258484924s) [upload=25512]: Upload finished. err: <nil> Aug 8 10:18:09.841643530 (24h38m44.356746109s) [upload=25524]: Starting upload Aug 8 10:18:09.841707253 (24h38m44.356809822s) [upload=25524]: Done starting upload Aug 8 10:18:09.841782697 (24h38m44.35688526s) [upload=25524]: Uploading segments... Aug 8 10:18:09.841827030 (24h38m44.356929615s) [upload=25524]: Got next segment. Inline: true Aug 8 10:18:09.841845384 (24h38m44.356947962s) [upload=25524]: Waiting for error group managing segments... Aug 8 10:18:09.841892035 (24h38m44.356994612s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:18:09.841901651 (24h38m44.357004228s) [upload=25524]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:18:09.841905159 (24h38m44.357007736s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:18:09.905896485 (24h38m44.420999051s) [upload=25524]: Done uploading segments... Aug 8 10:18:09.905913027 (24h38m44.421015593s) [upload=25524]: Upload finished. err: <nil> Aug 8 10:19:23.131461453 (24h39m57.646564033s) [upload=25542]: Starting upload Aug 8 10:19:23.131505897 (24h39m57.646608483s) [upload=25542]: Done starting upload Aug 8 10:19:23.131586149 (24h39m57.646688715s) [upload=25542]: Uploading segments... Aug 8 10:19:23.131649692 (24h39m57.646752277s) [upload=25542]: Got next segment. Inline: true Aug 8 10:19:23.131655195 (24h39m57.646757771s) [upload=25542]: Waiting for error group managing segments... Aug 8 10:19:23.131714698 (24h39m57.646817274s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:23.131719532 (24h39m57.646822109s) [upload=25542]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:23.131722759 (24h39m57.646825336s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:23.206304231 (24h39m57.721406802s) [upload=25542]: Done uploading segments... Aug 8 10:19:23.206326930 (24h39m57.721429497s) [upload=25542]: Upload finished. err: <nil> Aug 8 10:19:54.392300720 (24h40m28.907403287s) [upload=25548]: Starting upload Aug 8 10:19:54.392349163 (24h40m28.907451742s) [upload=25548]: Done starting upload Aug 8 10:19:54.392419702 (24h40m28.907522272s) [upload=25548]: Uploading segments... Aug 8 10:19:54.392455430 (24h40m28.907558015s) [upload=25548]: Got next segment. Inline: true Aug 8 10:19:54.392460240 (24h40m28.907562806s) [upload=25548]: Waiting for error group managing segments... Aug 8 10:19:54.392508955 (24h40m28.907611521s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:54.392513704 (24h40m28.907616283s) [upload=25548]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:54.392516750 (24h40m28.907619315s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:54.607175596 (24h40m29.122278175s) [upload=25548]: Done uploading segments... Aug 8 10:19:54.607193769 (24h40m29.122296335s) [upload=25548]: Upload finished. err: <nil> Aug 8 10:21:05.692737556 (24h41m40.207840123s) [upload=25567]: Starting upload Aug 8 10:21:05.692815089 (24h41m40.207917657s) [upload=25567]: Done starting upload Aug 8 10:21:05.692894948 (24h41m40.207997514s) [upload=25567]: Uploading segments... Aug 8 10:21:05.692944055 (24h41m40.208046641s) [upload=25567]: Got next segment. Inline: true Aug 8 10:21:05.692950912 (24h41m40.208053489s) [upload=25567]: Waiting for error group managing segments... Aug 8 10:21:05.692998236 (24h41m40.208100823s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:05.693004179 (24h41m40.20810676s) [upload=25567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:05.693007287 (24h41m40.208109867s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:05.757359800 (24h41m40.272462386s) [upload=25567]: Done uploading segments... Aug 8 10:21:05.757383050 (24h41m40.272485626s) [upload=25567]: Upload finished. err: <nil> Aug 8 10:21:53.504743996 (24h42m28.019846582s) [upload=25582]: Starting upload Aug 8 10:21:53.504817681 (24h42m28.019920261s) [upload=25582]: Done starting upload Aug 8 10:21:53.504908346 (24h42m28.020010928s) [upload=25582]: Uploading segments... Aug 8 10:21:53.504956252 (24h42m28.020058836s) [upload=25582]: Got next segment. Inline: true Aug 8 10:21:53.504962939 (24h42m28.020065516s) [upload=25582]: Waiting for error group managing segments... Aug 8 10:21:53.505014143 (24h42m28.020116729s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:53.505020195 (24h42m28.020122779s) [upload=25582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:53.505024975 (24h42m28.020127552s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:53.567859466 (24h42m28.082962043s) [upload=25582]: Done uploading segments... Aug 8 10:21:53.567875292 (24h42m28.082977868s) [upload=25582]: Upload finished. err: <nil> Aug 8 10:22:57.956939547 (24h43m32.472042133s) [upload=25598]: Starting upload Aug 8 10:22:57.956995820 (24h43m32.472098408s) [upload=25598]: Done starting upload Aug 8 10:22:57.957240080 (24h43m32.472342648s) [upload=25598]: Uploading segments... Aug 8 10:22:57.957311205 (24h43m32.472413791s) [upload=25598]: Got next segment. Inline: true Aug 8 10:22:57.957317746 (24h43m32.472420323s) [upload=25598]: Waiting for error group managing segments... Aug 8 10:22:57.957385033 (24h43m32.472487614s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:22:57.957390668 (24h43m32.472493246s) [upload=25598]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:22:57.957394180 (24h43m32.472496757s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:22:58.029812590 (24h43m32.544915169s) [upload=25598]: Done uploading segments... Aug 8 10:22:58.029834230 (24h43m32.544936798s) [upload=25598]: Upload finished. err: <nil> Aug 8 10:23:18.816059986 (24h43m53.331162571s) [upload=25604]: Starting upload Aug 8 10:23:18.816111932 (24h43m53.331214508s) [upload=25604]: Done starting upload Aug 8 10:23:18.816172180 (24h43m53.331274751s) [upload=25604]: Uploading segments... Aug 8 10:23:18.816210063 (24h43m53.331312649s) [upload=25604]: Got next segment. Inline: true Aug 8 10:23:18.816214426 (24h43m53.331316991s) [upload=25604]: Waiting for error group managing segments... Aug 8 10:23:18.816251408 (24h43m53.331353974s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:23:18.816255697 (24h43m53.331358273s) [upload=25604]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:23:18.816258801 (24h43m53.331361371s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:23:19.087130277 (24h43m53.602232846s) [upload=25604]: Done uploading segments... Aug 8 10:23:19.087151214 (24h43m53.602253781s) [upload=25604]: Upload finished. err: <nil> Aug 8 10:24:21.030100948 (24h44m55.545203519s) [upload=25623]: Starting upload Aug 8 10:24:21.030162897 (24h44m55.545265478s) [upload=25623]: Done starting upload Aug 8 10:24:21.030247890 (24h44m55.545350466s) [upload=25623]: Uploading segments... Aug 8 10:24:21.030299798 (24h44m55.545402387s) [upload=25623]: Got next segment. Inline: true Aug 8 10:24:21.030306830 (24h44m55.545409394s) [upload=25623]: Waiting for error group managing segments... Aug 8 10:24:21.030431847 (24h44m55.545534414s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:24:21.030438082 (24h44m55.545540659s) [upload=25623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:24:21.030441385 (24h44m55.545543966s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:24:21.039318112 (24h44m55.554420681s) [upload=25623]: Done uploading segments... Aug 8 10:24:21.039334812 (24h44m55.554437379s) [upload=25623]: Upload finished. err: metaclient: Too Many Requests Duration: 191.146043ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 470.292856ms FAIL (2025-08-08 10:27:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 470.326948ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 422.03605ms FAIL (2025-08-08 10:26:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 8 10:16:24.996444595 (24h36m59.511547171s) [upload=25489]: Upload finished. err: <nil> Aug 8 10:16:40.086056336 (24h37m14.601158902s) [upload=25494]: Starting upload Aug 8 10:16:40.086138218 (24h37m14.601240816s) [upload=25494]: Done starting upload Aug 8 10:16:40.086246239 (24h37m14.601348806s) [upload=25494]: Uploading segments... Aug 8 10:16:40.086322136 (24h37m14.601424723s) [upload=25494]: Got next segment. Inline: true Aug 8 10:16:40.086329274 (24h37m14.601431857s) [upload=25494]: Waiting for error group managing segments... Aug 8 10:16:40.086406338 (24h37m14.601508921s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:16:40.086412709 (24h37m14.601515298s) [upload=25494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:16:40.086433433 (24h37m14.601536015s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:16:40.147707180 (24h37m14.66280976s) [upload=25494]: Done uploading segments... Aug 8 10:16:40.147727908 (24h37m14.662830485s) [upload=25494]: Upload finished. err: <nil> Aug 8 10:17:33.679048155 (24h38m8.194150731s) [upload=25512]: Starting upload Aug 8 10:17:33.679106608 (24h38m8.194209187s) [upload=25512]: Done starting upload Aug 8 10:17:33.679160905 (24h38m8.194263481s) [upload=25512]: Uploading segments... Aug 8 10:17:33.679237763 (24h38m8.194340367s) [upload=25512]: Got next segment. Inline: true Aug 8 10:17:33.679243473 (24h38m8.194346036s) [upload=25512]: Waiting for error group managing segments... Aug 8 10:17:33.679305479 (24h38m8.194408056s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:17:33.679310678 (24h38m8.194413245s) [upload=25512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:17:33.679313670 (24h38m8.194416232s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:17:33.743363385 (24h38m8.258465953s) [upload=25512]: Done uploading segments... Aug 8 10:17:33.743382354 (24h38m8.258484924s) [upload=25512]: Upload finished. err: <nil> Aug 8 10:18:09.841643530 (24h38m44.356746109s) [upload=25524]: Starting upload Aug 8 10:18:09.841707253 (24h38m44.356809822s) [upload=25524]: Done starting upload Aug 8 10:18:09.841782697 (24h38m44.35688526s) [upload=25524]: Uploading segments... Aug 8 10:18:09.841827030 (24h38m44.356929615s) [upload=25524]: Got next segment. Inline: true Aug 8 10:18:09.841845384 (24h38m44.356947962s) [upload=25524]: Waiting for error group managing segments... Aug 8 10:18:09.841892035 (24h38m44.356994612s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:18:09.841901651 (24h38m44.357004228s) [upload=25524]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:18:09.841905159 (24h38m44.357007736s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:18:09.905896485 (24h38m44.420999051s) [upload=25524]: Done uploading segments... Aug 8 10:18:09.905913027 (24h38m44.421015593s) [upload=25524]: Upload finished. err: <nil> Aug 8 10:19:23.131461453 (24h39m57.646564033s) [upload=25542]: Starting upload Aug 8 10:19:23.131505897 (24h39m57.646608483s) [upload=25542]: Done starting upload Aug 8 10:19:23.131586149 (24h39m57.646688715s) [upload=25542]: Uploading segments... Aug 8 10:19:23.131649692 (24h39m57.646752277s) [upload=25542]: Got next segment. Inline: true Aug 8 10:19:23.131655195 (24h39m57.646757771s) [upload=25542]: Waiting for error group managing segments... Aug 8 10:19:23.131714698 (24h39m57.646817274s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:23.131719532 (24h39m57.646822109s) [upload=25542]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:23.131722759 (24h39m57.646825336s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:23.206304231 (24h39m57.721406802s) [upload=25542]: Done uploading segments... Aug 8 10:19:23.206326930 (24h39m57.721429497s) [upload=25542]: Upload finished. err: <nil> Aug 8 10:19:54.392300720 (24h40m28.907403287s) [upload=25548]: Starting upload Aug 8 10:19:54.392349163 (24h40m28.907451742s) [upload=25548]: Done starting upload Aug 8 10:19:54.392419702 (24h40m28.907522272s) [upload=25548]: Uploading segments... Aug 8 10:19:54.392455430 (24h40m28.907558015s) [upload=25548]: Got next segment. Inline: true Aug 8 10:19:54.392460240 (24h40m28.907562806s) [upload=25548]: Waiting for error group managing segments... Aug 8 10:19:54.392508955 (24h40m28.907611521s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:54.392513704 (24h40m28.907616283s) [upload=25548]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:54.392516750 (24h40m28.907619315s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:54.607175596 (24h40m29.122278175s) [upload=25548]: Done uploading segments... Aug 8 10:19:54.607193769 (24h40m29.122296335s) [upload=25548]: Upload finished. err: <nil> Aug 8 10:21:05.692737556 (24h41m40.207840123s) [upload=25567]: Starting upload Aug 8 10:21:05.692815089 (24h41m40.207917657s) [upload=25567]: Done starting upload Aug 8 10:21:05.692894948 (24h41m40.207997514s) [upload=25567]: Uploading segments... Aug 8 10:21:05.692944055 (24h41m40.208046641s) [upload=25567]: Got next segment. Inline: true Aug 8 10:21:05.692950912 (24h41m40.208053489s) [upload=25567]: Waiting for error group managing segments... Aug 8 10:21:05.692998236 (24h41m40.208100823s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:05.693004179 (24h41m40.20810676s) [upload=25567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:05.693007287 (24h41m40.208109867s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:05.757359800 (24h41m40.272462386s) [upload=25567]: Done uploading segments... Aug 8 10:21:05.757383050 (24h41m40.272485626s) [upload=25567]: Upload finished. err: <nil> Aug 8 10:21:53.504743996 (24h42m28.019846582s) [upload=25582]: Starting upload Aug 8 10:21:53.504817681 (24h42m28.019920261s) [upload=25582]: Done starting upload Aug 8 10:21:53.504908346 (24h42m28.020010928s) [upload=25582]: Uploading segments... Aug 8 10:21:53.504956252 (24h42m28.020058836s) [upload=25582]: Got next segment. Inline: true Aug 8 10:21:53.504962939 (24h42m28.020065516s) [upload=25582]: Waiting for error group managing segments... Aug 8 10:21:53.505014143 (24h42m28.020116729s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:53.505020195 (24h42m28.020122779s) [upload=25582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:53.505024975 (24h42m28.020127552s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:53.567859466 (24h42m28.082962043s) [upload=25582]: Done uploading segments... Aug 8 10:21:53.567875292 (24h42m28.082977868s) [upload=25582]: Upload finished. err: <nil> Aug 8 10:22:57.956939547 (24h43m32.472042133s) [upload=25598]: Starting upload Aug 8 10:22:57.956995820 (24h43m32.472098408s) [upload=25598]: Done starting upload Aug 8 10:22:57.957240080 (24h43m32.472342648s) [upload=25598]: Uploading segments... Aug 8 10:22:57.957311205 (24h43m32.472413791s) [upload=25598]: Got next segment. Inline: true Aug 8 10:22:57.957317746 (24h43m32.472420323s) [upload=25598]: Waiting for error group managing segments... Aug 8 10:22:57.957385033 (24h43m32.472487614s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:22:57.957390668 (24h43m32.472493246s) [upload=25598]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:22:57.957394180 (24h43m32.472496757s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:22:58.029812590 (24h43m32.544915169s) [upload=25598]: Done uploading segments... Aug 8 10:22:58.029834230 (24h43m32.544936798s) [upload=25598]: Upload finished. err: <nil> Aug 8 10:23:18.816059986 (24h43m53.331162571s) [upload=25604]: Starting upload Aug 8 10:23:18.816111932 (24h43m53.331214508s) [upload=25604]: Done starting upload Aug 8 10:23:18.816172180 (24h43m53.331274751s) [upload=25604]: Uploading segments... Aug 8 10:23:18.816210063 (24h43m53.331312649s) [upload=25604]: Got next segment. Inline: true Aug 8 10:23:18.816214426 (24h43m53.331316991s) [upload=25604]: Waiting for error group managing segments... Aug 8 10:23:18.816251408 (24h43m53.331353974s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:23:18.816255697 (24h43m53.331358273s) [upload=25604]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:23:18.816258801 (24h43m53.331361371s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:23:19.087130277 (24h43m53.602232846s) [upload=25604]: Done uploading segments... Aug 8 10:23:19.087151214 (24h43m53.602253781s) [upload=25604]: Upload finished. err: <nil> Aug 8 10:24:21.030100948 (24h44m55.545203519s) [upload=25623]: Starting upload Aug 8 10:24:21.030162897 (24h44m55.545265478s) [upload=25623]: Done starting upload Aug 8 10:24:21.030247890 (24h44m55.545350466s) [upload=25623]: Uploading segments... Aug 8 10:24:21.030299798 (24h44m55.545402387s) [upload=25623]: Got next segment. Inline: true Aug 8 10:24:21.030306830 (24h44m55.545409394s) [upload=25623]: Waiting for error group managing segments... Aug 8 10:24:21.030431847 (24h44m55.545534414s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:24:21.030438082 (24h44m55.545540659s) [upload=25623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:24:21.030441385 (24h44m55.545543966s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:24:21.039318112 (24h44m55.554420681s) [upload=25623]: Done uploading segments... Aug 8 10:24:21.039334812 (24h44m55.554437379s) [upload=25623]: Upload finished. err: metaclient: Too Many Requests Duration: 422.076661ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 178.499383ms FAIL (2025-08-08 10:26:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 8 10:16:24.996444595 (24h36m59.511547171s) [upload=25489]: Upload finished. err: <nil> Aug 8 10:16:40.086056336 (24h37m14.601158902s) [upload=25494]: Starting upload Aug 8 10:16:40.086138218 (24h37m14.601240816s) [upload=25494]: Done starting upload Aug 8 10:16:40.086246239 (24h37m14.601348806s) [upload=25494]: Uploading segments... Aug 8 10:16:40.086322136 (24h37m14.601424723s) [upload=25494]: Got next segment. Inline: true Aug 8 10:16:40.086329274 (24h37m14.601431857s) [upload=25494]: Waiting for error group managing segments... Aug 8 10:16:40.086406338 (24h37m14.601508921s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:16:40.086412709 (24h37m14.601515298s) [upload=25494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:16:40.086433433 (24h37m14.601536015s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:16:40.147707180 (24h37m14.66280976s) [upload=25494]: Done uploading segments... Aug 8 10:16:40.147727908 (24h37m14.662830485s) [upload=25494]: Upload finished. err: <nil> Aug 8 10:17:33.679048155 (24h38m8.194150731s) [upload=25512]: Starting upload Aug 8 10:17:33.679106608 (24h38m8.194209187s) [upload=25512]: Done starting upload Aug 8 10:17:33.679160905 (24h38m8.194263481s) [upload=25512]: Uploading segments... Aug 8 10:17:33.679237763 (24h38m8.194340367s) [upload=25512]: Got next segment. Inline: true Aug 8 10:17:33.679243473 (24h38m8.194346036s) [upload=25512]: Waiting for error group managing segments... Aug 8 10:17:33.679305479 (24h38m8.194408056s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:17:33.679310678 (24h38m8.194413245s) [upload=25512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:17:33.679313670 (24h38m8.194416232s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:17:33.743363385 (24h38m8.258465953s) [upload=25512]: Done uploading segments... Aug 8 10:17:33.743382354 (24h38m8.258484924s) [upload=25512]: Upload finished. err: <nil> Aug 8 10:18:09.841643530 (24h38m44.356746109s) [upload=25524]: Starting upload Aug 8 10:18:09.841707253 (24h38m44.356809822s) [upload=25524]: Done starting upload Aug 8 10:18:09.841782697 (24h38m44.35688526s) [upload=25524]: Uploading segments... Aug 8 10:18:09.841827030 (24h38m44.356929615s) [upload=25524]: Got next segment. Inline: true Aug 8 10:18:09.841845384 (24h38m44.356947962s) [upload=25524]: Waiting for error group managing segments... Aug 8 10:18:09.841892035 (24h38m44.356994612s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:18:09.841901651 (24h38m44.357004228s) [upload=25524]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:18:09.841905159 (24h38m44.357007736s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:18:09.905896485 (24h38m44.420999051s) [upload=25524]: Done uploading segments... Aug 8 10:18:09.905913027 (24h38m44.421015593s) [upload=25524]: Upload finished. err: <nil> Aug 8 10:19:23.131461453 (24h39m57.646564033s) [upload=25542]: Starting upload Aug 8 10:19:23.131505897 (24h39m57.646608483s) [upload=25542]: Done starting upload Aug 8 10:19:23.131586149 (24h39m57.646688715s) [upload=25542]: Uploading segments... Aug 8 10:19:23.131649692 (24h39m57.646752277s) [upload=25542]: Got next segment. Inline: true Aug 8 10:19:23.131655195 (24h39m57.646757771s) [upload=25542]: Waiting for error group managing segments... Aug 8 10:19:23.131714698 (24h39m57.646817274s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:23.131719532 (24h39m57.646822109s) [upload=25542]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:23.131722759 (24h39m57.646825336s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:23.206304231 (24h39m57.721406802s) [upload=25542]: Done uploading segments... Aug 8 10:19:23.206326930 (24h39m57.721429497s) [upload=25542]: Upload finished. err: <nil> Aug 8 10:19:54.392300720 (24h40m28.907403287s) [upload=25548]: Starting upload Aug 8 10:19:54.392349163 (24h40m28.907451742s) [upload=25548]: Done starting upload Aug 8 10:19:54.392419702 (24h40m28.907522272s) [upload=25548]: Uploading segments... Aug 8 10:19:54.392455430 (24h40m28.907558015s) [upload=25548]: Got next segment. Inline: true Aug 8 10:19:54.392460240 (24h40m28.907562806s) [upload=25548]: Waiting for error group managing segments... Aug 8 10:19:54.392508955 (24h40m28.907611521s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:54.392513704 (24h40m28.907616283s) [upload=25548]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:54.392516750 (24h40m28.907619315s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:54.607175596 (24h40m29.122278175s) [upload=25548]: Done uploading segments... Aug 8 10:19:54.607193769 (24h40m29.122296335s) [upload=25548]: Upload finished. err: <nil> Aug 8 10:21:05.692737556 (24h41m40.207840123s) [upload=25567]: Starting upload Aug 8 10:21:05.692815089 (24h41m40.207917657s) [upload=25567]: Done starting upload Aug 8 10:21:05.692894948 (24h41m40.207997514s) [upload=25567]: Uploading segments... Aug 8 10:21:05.692944055 (24h41m40.208046641s) [upload=25567]: Got next segment. Inline: true Aug 8 10:21:05.692950912 (24h41m40.208053489s) [upload=25567]: Waiting for error group managing segments... Aug 8 10:21:05.692998236 (24h41m40.208100823s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:05.693004179 (24h41m40.20810676s) [upload=25567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:05.693007287 (24h41m40.208109867s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:05.757359800 (24h41m40.272462386s) [upload=25567]: Done uploading segments... Aug 8 10:21:05.757383050 (24h41m40.272485626s) [upload=25567]: Upload finished. err: <nil> Aug 8 10:21:53.504743996 (24h42m28.019846582s) [upload=25582]: Starting upload Aug 8 10:21:53.504817681 (24h42m28.019920261s) [upload=25582]: Done starting upload Aug 8 10:21:53.504908346 (24h42m28.020010928s) [upload=25582]: Uploading segments... Aug 8 10:21:53.504956252 (24h42m28.020058836s) [upload=25582]: Got next segment. Inline: true Aug 8 10:21:53.504962939 (24h42m28.020065516s) [upload=25582]: Waiting for error group managing segments... Aug 8 10:21:53.505014143 (24h42m28.020116729s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:53.505020195 (24h42m28.020122779s) [upload=25582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:53.505024975 (24h42m28.020127552s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:53.567859466 (24h42m28.082962043s) [upload=25582]: Done uploading segments... Aug 8 10:21:53.567875292 (24h42m28.082977868s) [upload=25582]: Upload finished. err: <nil> Aug 8 10:22:57.956939547 (24h43m32.472042133s) [upload=25598]: Starting upload Aug 8 10:22:57.956995820 (24h43m32.472098408s) [upload=25598]: Done starting upload Aug 8 10:22:57.957240080 (24h43m32.472342648s) [upload=25598]: Uploading segments... Aug 8 10:22:57.957311205 (24h43m32.472413791s) [upload=25598]: Got next segment. Inline: true Aug 8 10:22:57.957317746 (24h43m32.472420323s) [upload=25598]: Waiting for error group managing segments... Aug 8 10:22:57.957385033 (24h43m32.472487614s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:22:57.957390668 (24h43m32.472493246s) [upload=25598]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:22:57.957394180 (24h43m32.472496757s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:22:58.029812590 (24h43m32.544915169s) [upload=25598]: Done uploading segments... Aug 8 10:22:58.029834230 (24h43m32.544936798s) [upload=25598]: Upload finished. err: <nil> Aug 8 10:23:18.816059986 (24h43m53.331162571s) [upload=25604]: Starting upload Aug 8 10:23:18.816111932 (24h43m53.331214508s) [upload=25604]: Done starting upload Aug 8 10:23:18.816172180 (24h43m53.331274751s) [upload=25604]: Uploading segments... Aug 8 10:23:18.816210063 (24h43m53.331312649s) [upload=25604]: Got next segment. Inline: true Aug 8 10:23:18.816214426 (24h43m53.331316991s) [upload=25604]: Waiting for error group managing segments... Aug 8 10:23:18.816251408 (24h43m53.331353974s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:23:18.816255697 (24h43m53.331358273s) [upload=25604]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:23:18.816258801 (24h43m53.331361371s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:23:19.087130277 (24h43m53.602232846s) [upload=25604]: Done uploading segments... Aug 8 10:23:19.087151214 (24h43m53.602253781s) [upload=25604]: Upload finished. err: <nil> Aug 8 10:24:21.030100948 (24h44m55.545203519s) [upload=25623]: Starting upload Aug 8 10:24:21.030162897 (24h44m55.545265478s) [upload=25623]: Done starting upload Aug 8 10:24:21.030247890 (24h44m55.545350466s) [upload=25623]: Uploading segments... Aug 8 10:24:21.030299798 (24h44m55.545402387s) [upload=25623]: Got next segment. Inline: true Aug 8 10:24:21.030306830 (24h44m55.545409394s) [upload=25623]: Waiting for error group managing segments... Aug 8 10:24:21.030431847 (24h44m55.545534414s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:24:21.030438082 (24h44m55.545540659s) [upload=25623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:24:21.030441385 (24h44m55.545543966s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:24:21.039318112 (24h44m55.554420681s) [upload=25623]: Done uploading segments... Aug 8 10:24:21.039334812 (24h44m55.554437379s) [upload=25623]: Upload finished. err: metaclient: Too Many Requests Duration: 178.533521ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 545.061229ms FAIL (2025-08-08 10:26:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 545.252306ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 199.719089ms FAIL (2025-08-08 10:25:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 8 10:16:24.996444595 (24h36m59.511547171s) [upload=25489]: Upload finished. err: <nil> Aug 8 10:16:40.086056336 (24h37m14.601158902s) [upload=25494]: Starting upload Aug 8 10:16:40.086138218 (24h37m14.601240816s) [upload=25494]: Done starting upload Aug 8 10:16:40.086246239 (24h37m14.601348806s) [upload=25494]: Uploading segments... Aug 8 10:16:40.086322136 (24h37m14.601424723s) [upload=25494]: Got next segment. Inline: true Aug 8 10:16:40.086329274 (24h37m14.601431857s) [upload=25494]: Waiting for error group managing segments... Aug 8 10:16:40.086406338 (24h37m14.601508921s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:16:40.086412709 (24h37m14.601515298s) [upload=25494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:16:40.086433433 (24h37m14.601536015s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:16:40.147707180 (24h37m14.66280976s) [upload=25494]: Done uploading segments... Aug 8 10:16:40.147727908 (24h37m14.662830485s) [upload=25494]: Upload finished. err: <nil> Aug 8 10:17:33.679048155 (24h38m8.194150731s) [upload=25512]: Starting upload Aug 8 10:17:33.679106608 (24h38m8.194209187s) [upload=25512]: Done starting upload Aug 8 10:17:33.679160905 (24h38m8.194263481s) [upload=25512]: Uploading segments... Aug 8 10:17:33.679237763 (24h38m8.194340367s) [upload=25512]: Got next segment. Inline: true Aug 8 10:17:33.679243473 (24h38m8.194346036s) [upload=25512]: Waiting for error group managing segments... Aug 8 10:17:33.679305479 (24h38m8.194408056s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:17:33.679310678 (24h38m8.194413245s) [upload=25512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:17:33.679313670 (24h38m8.194416232s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:17:33.743363385 (24h38m8.258465953s) [upload=25512]: Done uploading segments... Aug 8 10:17:33.743382354 (24h38m8.258484924s) [upload=25512]: Upload finished. err: <nil> Aug 8 10:18:09.841643530 (24h38m44.356746109s) [upload=25524]: Starting upload Aug 8 10:18:09.841707253 (24h38m44.356809822s) [upload=25524]: Done starting upload Aug 8 10:18:09.841782697 (24h38m44.35688526s) [upload=25524]: Uploading segments... Aug 8 10:18:09.841827030 (24h38m44.356929615s) [upload=25524]: Got next segment. Inline: true Aug 8 10:18:09.841845384 (24h38m44.356947962s) [upload=25524]: Waiting for error group managing segments... Aug 8 10:18:09.841892035 (24h38m44.356994612s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:18:09.841901651 (24h38m44.357004228s) [upload=25524]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:18:09.841905159 (24h38m44.357007736s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:18:09.905896485 (24h38m44.420999051s) [upload=25524]: Done uploading segments... Aug 8 10:18:09.905913027 (24h38m44.421015593s) [upload=25524]: Upload finished. err: <nil> Aug 8 10:19:23.131461453 (24h39m57.646564033s) [upload=25542]: Starting upload Aug 8 10:19:23.131505897 (24h39m57.646608483s) [upload=25542]: Done starting upload Aug 8 10:19:23.131586149 (24h39m57.646688715s) [upload=25542]: Uploading segments... Aug 8 10:19:23.131649692 (24h39m57.646752277s) [upload=25542]: Got next segment. Inline: true Aug 8 10:19:23.131655195 (24h39m57.646757771s) [upload=25542]: Waiting for error group managing segments... Aug 8 10:19:23.131714698 (24h39m57.646817274s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:23.131719532 (24h39m57.646822109s) [upload=25542]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:23.131722759 (24h39m57.646825336s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:23.206304231 (24h39m57.721406802s) [upload=25542]: Done uploading segments... Aug 8 10:19:23.206326930 (24h39m57.721429497s) [upload=25542]: Upload finished. err: <nil> Aug 8 10:19:54.392300720 (24h40m28.907403287s) [upload=25548]: Starting upload Aug 8 10:19:54.392349163 (24h40m28.907451742s) [upload=25548]: Done starting upload Aug 8 10:19:54.392419702 (24h40m28.907522272s) [upload=25548]: Uploading segments... Aug 8 10:19:54.392455430 (24h40m28.907558015s) [upload=25548]: Got next segment. Inline: true Aug 8 10:19:54.392460240 (24h40m28.907562806s) [upload=25548]: Waiting for error group managing segments... Aug 8 10:19:54.392508955 (24h40m28.907611521s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:54.392513704 (24h40m28.907616283s) [upload=25548]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:54.392516750 (24h40m28.907619315s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:54.607175596 (24h40m29.122278175s) [upload=25548]: Done uploading segments... Aug 8 10:19:54.607193769 (24h40m29.122296335s) [upload=25548]: Upload finished. err: <nil> Aug 8 10:21:05.692737556 (24h41m40.207840123s) [upload=25567]: Starting upload Aug 8 10:21:05.692815089 (24h41m40.207917657s) [upload=25567]: Done starting upload Aug 8 10:21:05.692894948 (24h41m40.207997514s) [upload=25567]: Uploading segments... Aug 8 10:21:05.692944055 (24h41m40.208046641s) [upload=25567]: Got next segment. Inline: true Aug 8 10:21:05.692950912 (24h41m40.208053489s) [upload=25567]: Waiting for error group managing segments... Aug 8 10:21:05.692998236 (24h41m40.208100823s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:05.693004179 (24h41m40.20810676s) [upload=25567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:05.693007287 (24h41m40.208109867s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:05.757359800 (24h41m40.272462386s) [upload=25567]: Done uploading segments... Aug 8 10:21:05.757383050 (24h41m40.272485626s) [upload=25567]: Upload finished. err: <nil> Aug 8 10:21:53.504743996 (24h42m28.019846582s) [upload=25582]: Starting upload Aug 8 10:21:53.504817681 (24h42m28.019920261s) [upload=25582]: Done starting upload Aug 8 10:21:53.504908346 (24h42m28.020010928s) [upload=25582]: Uploading segments... Aug 8 10:21:53.504956252 (24h42m28.020058836s) [upload=25582]: Got next segment. Inline: true Aug 8 10:21:53.504962939 (24h42m28.020065516s) [upload=25582]: Waiting for error group managing segments... Aug 8 10:21:53.505014143 (24h42m28.020116729s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:53.505020195 (24h42m28.020122779s) [upload=25582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:53.505024975 (24h42m28.020127552s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:53.567859466 (24h42m28.082962043s) [upload=25582]: Done uploading segments... Aug 8 10:21:53.567875292 (24h42m28.082977868s) [upload=25582]: Upload finished. err: <nil> Aug 8 10:22:57.956939547 (24h43m32.472042133s) [upload=25598]: Starting upload Aug 8 10:22:57.956995820 (24h43m32.472098408s) [upload=25598]: Done starting upload Aug 8 10:22:57.957240080 (24h43m32.472342648s) [upload=25598]: Uploading segments... Aug 8 10:22:57.957311205 (24h43m32.472413791s) [upload=25598]: Got next segment. Inline: true Aug 8 10:22:57.957317746 (24h43m32.472420323s) [upload=25598]: Waiting for error group managing segments... Aug 8 10:22:57.957385033 (24h43m32.472487614s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:22:57.957390668 (24h43m32.472493246s) [upload=25598]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:22:57.957394180 (24h43m32.472496757s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:22:58.029812590 (24h43m32.544915169s) [upload=25598]: Done uploading segments... Aug 8 10:22:58.029834230 (24h43m32.544936798s) [upload=25598]: Upload finished. err: <nil> Aug 8 10:23:18.816059986 (24h43m53.331162571s) [upload=25604]: Starting upload Aug 8 10:23:18.816111932 (24h43m53.331214508s) [upload=25604]: Done starting upload Aug 8 10:23:18.816172180 (24h43m53.331274751s) [upload=25604]: Uploading segments... Aug 8 10:23:18.816210063 (24h43m53.331312649s) [upload=25604]: Got next segment. Inline: true Aug 8 10:23:18.816214426 (24h43m53.331316991s) [upload=25604]: Waiting for error group managing segments... Aug 8 10:23:18.816251408 (24h43m53.331353974s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:23:18.816255697 (24h43m53.331358273s) [upload=25604]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:23:18.816258801 (24h43m53.331361371s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:23:19.087130277 (24h43m53.602232846s) [upload=25604]: Done uploading segments... Aug 8 10:23:19.087151214 (24h43m53.602253781s) [upload=25604]: Upload finished. err: <nil> Aug 8 10:24:21.030100948 (24h44m55.545203519s) [upload=25623]: Starting upload Aug 8 10:24:21.030162897 (24h44m55.545265478s) [upload=25623]: Done starting upload Aug 8 10:24:21.030247890 (24h44m55.545350466s) [upload=25623]: Uploading segments... Aug 8 10:24:21.030299798 (24h44m55.545402387s) [upload=25623]: Got next segment. Inline: true Aug 8 10:24:21.030306830 (24h44m55.545409394s) [upload=25623]: Waiting for error group managing segments... Aug 8 10:24:21.030431847 (24h44m55.545534414s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:24:21.030438082 (24h44m55.545540659s) [upload=25623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:24:21.030441385 (24h44m55.545543966s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:24:21.039318112 (24h44m55.554420681s) [upload=25623]: Done uploading segments... Aug 8 10:24:21.039334812 (24h44m55.554437379s) [upload=25623]: Upload finished. err: metaclient: Too Many Requests Duration: 199.750013ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 385.360701ms FAIL (2025-08-08 10:25:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 385.59408ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 40.707679ms FAIL (2025-08-08 10:24:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 8 10:16:24.996444595 (24h36m59.511547171s) [upload=25489]: Upload finished. err: <nil> Aug 8 10:16:40.086056336 (24h37m14.601158902s) [upload=25494]: Starting upload Aug 8 10:16:40.086138218 (24h37m14.601240816s) [upload=25494]: Done starting upload Aug 8 10:16:40.086246239 (24h37m14.601348806s) [upload=25494]: Uploading segments... Aug 8 10:16:40.086322136 (24h37m14.601424723s) [upload=25494]: Got next segment. Inline: true Aug 8 10:16:40.086329274 (24h37m14.601431857s) [upload=25494]: Waiting for error group managing segments... Aug 8 10:16:40.086406338 (24h37m14.601508921s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:16:40.086412709 (24h37m14.601515298s) [upload=25494]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:16:40.086433433 (24h37m14.601536015s) [upload=25494]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:16:40.147707180 (24h37m14.66280976s) [upload=25494]: Done uploading segments... Aug 8 10:16:40.147727908 (24h37m14.662830485s) [upload=25494]: Upload finished. err: <nil> Aug 8 10:17:33.679048155 (24h38m8.194150731s) [upload=25512]: Starting upload Aug 8 10:17:33.679106608 (24h38m8.194209187s) [upload=25512]: Done starting upload Aug 8 10:17:33.679160905 (24h38m8.194263481s) [upload=25512]: Uploading segments... Aug 8 10:17:33.679237763 (24h38m8.194340367s) [upload=25512]: Got next segment. Inline: true Aug 8 10:17:33.679243473 (24h38m8.194346036s) [upload=25512]: Waiting for error group managing segments... Aug 8 10:17:33.679305479 (24h38m8.194408056s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:17:33.679310678 (24h38m8.194413245s) [upload=25512]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:17:33.679313670 (24h38m8.194416232s) [upload=25512]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:17:33.743363385 (24h38m8.258465953s) [upload=25512]: Done uploading segments... Aug 8 10:17:33.743382354 (24h38m8.258484924s) [upload=25512]: Upload finished. err: <nil> Aug 8 10:18:09.841643530 (24h38m44.356746109s) [upload=25524]: Starting upload Aug 8 10:18:09.841707253 (24h38m44.356809822s) [upload=25524]: Done starting upload Aug 8 10:18:09.841782697 (24h38m44.35688526s) [upload=25524]: Uploading segments... Aug 8 10:18:09.841827030 (24h38m44.356929615s) [upload=25524]: Got next segment. Inline: true Aug 8 10:18:09.841845384 (24h38m44.356947962s) [upload=25524]: Waiting for error group managing segments... Aug 8 10:18:09.841892035 (24h38m44.356994612s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:18:09.841901651 (24h38m44.357004228s) [upload=25524]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:18:09.841905159 (24h38m44.357007736s) [upload=25524]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:18:09.905896485 (24h38m44.420999051s) [upload=25524]: Done uploading segments... Aug 8 10:18:09.905913027 (24h38m44.421015593s) [upload=25524]: Upload finished. err: <nil> Aug 8 10:19:23.131461453 (24h39m57.646564033s) [upload=25542]: Starting upload Aug 8 10:19:23.131505897 (24h39m57.646608483s) [upload=25542]: Done starting upload Aug 8 10:19:23.131586149 (24h39m57.646688715s) [upload=25542]: Uploading segments... Aug 8 10:19:23.131649692 (24h39m57.646752277s) [upload=25542]: Got next segment. Inline: true Aug 8 10:19:23.131655195 (24h39m57.646757771s) [upload=25542]: Waiting for error group managing segments... Aug 8 10:19:23.131714698 (24h39m57.646817274s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:23.131719532 (24h39m57.646822109s) [upload=25542]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:23.131722759 (24h39m57.646825336s) [upload=25542]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:23.206304231 (24h39m57.721406802s) [upload=25542]: Done uploading segments... Aug 8 10:19:23.206326930 (24h39m57.721429497s) [upload=25542]: Upload finished. err: <nil> Aug 8 10:19:54.392300720 (24h40m28.907403287s) [upload=25548]: Starting upload Aug 8 10:19:54.392349163 (24h40m28.907451742s) [upload=25548]: Done starting upload Aug 8 10:19:54.392419702 (24h40m28.907522272s) [upload=25548]: Uploading segments... Aug 8 10:19:54.392455430 (24h40m28.907558015s) [upload=25548]: Got next segment. Inline: true Aug 8 10:19:54.392460240 (24h40m28.907562806s) [upload=25548]: Waiting for error group managing segments... Aug 8 10:19:54.392508955 (24h40m28.907611521s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:19:54.392513704 (24h40m28.907616283s) [upload=25548]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:19:54.392516750 (24h40m28.907619315s) [upload=25548]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:19:54.607175596 (24h40m29.122278175s) [upload=25548]: Done uploading segments... Aug 8 10:19:54.607193769 (24h40m29.122296335s) [upload=25548]: Upload finished. err: <nil> Aug 8 10:21:05.692737556 (24h41m40.207840123s) [upload=25567]: Starting upload Aug 8 10:21:05.692815089 (24h41m40.207917657s) [upload=25567]: Done starting upload Aug 8 10:21:05.692894948 (24h41m40.207997514s) [upload=25567]: Uploading segments... Aug 8 10:21:05.692944055 (24h41m40.208046641s) [upload=25567]: Got next segment. Inline: true Aug 8 10:21:05.692950912 (24h41m40.208053489s) [upload=25567]: Waiting for error group managing segments... Aug 8 10:21:05.692998236 (24h41m40.208100823s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:05.693004179 (24h41m40.20810676s) [upload=25567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:05.693007287 (24h41m40.208109867s) [upload=25567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:05.757359800 (24h41m40.272462386s) [upload=25567]: Done uploading segments... Aug 8 10:21:05.757383050 (24h41m40.272485626s) [upload=25567]: Upload finished. err: <nil> Aug 8 10:21:53.504743996 (24h42m28.019846582s) [upload=25582]: Starting upload Aug 8 10:21:53.504817681 (24h42m28.019920261s) [upload=25582]: Done starting upload Aug 8 10:21:53.504908346 (24h42m28.020010928s) [upload=25582]: Uploading segments... Aug 8 10:21:53.504956252 (24h42m28.020058836s) [upload=25582]: Got next segment. Inline: true Aug 8 10:21:53.504962939 (24h42m28.020065516s) [upload=25582]: Waiting for error group managing segments... Aug 8 10:21:53.505014143 (24h42m28.020116729s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:21:53.505020195 (24h42m28.020122779s) [upload=25582]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:21:53.505024975 (24h42m28.020127552s) [upload=25582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:21:53.567859466 (24h42m28.082962043s) [upload=25582]: Done uploading segments... Aug 8 10:21:53.567875292 (24h42m28.082977868s) [upload=25582]: Upload finished. err: <nil> Aug 8 10:22:57.956939547 (24h43m32.472042133s) [upload=25598]: Starting upload Aug 8 10:22:57.956995820 (24h43m32.472098408s) [upload=25598]: Done starting upload Aug 8 10:22:57.957240080 (24h43m32.472342648s) [upload=25598]: Uploading segments... Aug 8 10:22:57.957311205 (24h43m32.472413791s) [upload=25598]: Got next segment. Inline: true Aug 8 10:22:57.957317746 (24h43m32.472420323s) [upload=25598]: Waiting for error group managing segments... Aug 8 10:22:57.957385033 (24h43m32.472487614s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:22:57.957390668 (24h43m32.472493246s) [upload=25598]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:22:57.957394180 (24h43m32.472496757s) [upload=25598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:22:58.029812590 (24h43m32.544915169s) [upload=25598]: Done uploading segments... Aug 8 10:22:58.029834230 (24h43m32.544936798s) [upload=25598]: Upload finished. err: <nil> Aug 8 10:23:18.816059986 (24h43m53.331162571s) [upload=25604]: Starting upload Aug 8 10:23:18.816111932 (24h43m53.331214508s) [upload=25604]: Done starting upload Aug 8 10:23:18.816172180 (24h43m53.331274751s) [upload=25604]: Uploading segments... Aug 8 10:23:18.816210063 (24h43m53.331312649s) [upload=25604]: Got next segment. Inline: true Aug 8 10:23:18.816214426 (24h43m53.331316991s) [upload=25604]: Waiting for error group managing segments... Aug 8 10:23:18.816251408 (24h43m53.331353974s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:23:18.816255697 (24h43m53.331358273s) [upload=25604]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:23:18.816258801 (24h43m53.331361371s) [upload=25604]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:23:19.087130277 (24h43m53.602232846s) [upload=25604]: Done uploading segments... Aug 8 10:23:19.087151214 (24h43m53.602253781s) [upload=25604]: Upload finished. err: <nil> Aug 8 10:24:21.030100948 (24h44m55.545203519s) [upload=25623]: Starting upload Aug 8 10:24:21.030162897 (24h44m55.545265478s) [upload=25623]: Done starting upload Aug 8 10:24:21.030247890 (24h44m55.545350466s) [upload=25623]: Uploading segments... Aug 8 10:24:21.030299798 (24h44m55.545402387s) [upload=25623]: Got next segment. Inline: true Aug 8 10:24:21.030306830 (24h44m55.545409394s) [upload=25623]: Waiting for error group managing segments... Aug 8 10:24:21.030431847 (24h44m55.545534414s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 10:24:21.030438082 (24h44m55.545540659s) [upload=25623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 10:24:21.030441385 (24h44m55.545543966s) [upload=25623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 10:24:21.039318112 (24h44m55.554420681s) [upload=25623]: Done uploading segments... Aug 8 10:24:21.039334812 (24h44m55.554437379s) [upload=25623]: Upload finished. err: metaclient: Too Many Requests Duration: 40.726393ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 412.84539ms FAIL (2025-08-08 10:24:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 412.876046ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 412.115415ms FAIL (2025-08-08 10:23:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 412.147494ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 374.150534ms FAIL (2025-08-08 10:23:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 374.174587ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 399.969002ms FAIL (2025-08-08 10:23:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 400.000954ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 554.933822ms FAIL (2025-08-08 10:22:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 554.960494ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 586.570451ms FAIL (2025-08-08 10:22:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 586.595443ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 974.57096ms FAIL (2025-08-08 10:21:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 974.600715ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 720.61577ms FAIL (2025-08-08 10:20:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 720.647681ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 423.723383ms FAIL (2025-08-08 10:20:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 423.751883ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 1.496603388s FAIL (2025-08-08 10:19:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 1.496628721s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 408.196308ms FAIL (2025-08-08 10:18:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 408.224569ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 452.620997ms FAIL (2025-08-08 10:17:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 452.654369ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 475.294462ms FAIL (2025-08-08 10:17:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 475.328741ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 466.866159ms FAIL (2025-08-08 10:16:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 466.894202ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 461.279891ms FAIL (2025-08-08 10:16:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 461.334279ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 396.205001ms FAIL (2025-08-08 10:15:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 396.232867ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 407.001425ms FAIL (2025-08-08 10:15:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 407.040658ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 394.102497ms FAIL (2025-08-08 10:14:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 394.126589ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 388.744619ms FAIL (2025-08-08 10:13:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 388.770647ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 404.186236ms FAIL (2025-08-08 10:13:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 404.217336ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 432.190042ms FAIL (2025-08-08 10:11:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 432.219277ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 376.511579ms FAIL (2025-08-08 10:11:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 376.539753ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 462.637296ms FAIL (2025-08-08 10:10:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 462.670006ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 438.955044ms FAIL (2025-08-08 10:10:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 438.985913ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 427.896862ms FAIL (2025-08-08 10:09:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 427.92979ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 421.718857ms FAIL (2025-08-08 10:08:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 421.755436ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 384.650276ms FAIL (2025-08-08 10:07:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 384.684432ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 387.250943ms FAIL (2025-08-08 10:06:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 387.280085ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 426.984956ms FAIL (2025-08-08 10:06:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 427.026353ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 443.586649ms FAIL (2025-08-08 10:05:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 443.63707ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 836.104134ms FAIL (2025-08-08 10:04:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 836.131332ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 443.130207ms FAIL (2025-08-08 10:03:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 443.154607ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 409.722162ms FAIL (2025-08-08 10:01:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 409.750067ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 198.710688ms FAIL (2025-08-08 10:01:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 198.736037ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 540.397242ms FAIL (2025-08-08 10:00:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 540.435572ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 194.272574ms FAIL (2025-08-08 10:00:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 194.312128ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 1.299001343s FAIL (2025-08-08 10:00:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6m7.755526365s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240436665 (24h6m7.755539252s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.240958111 (24h6m7.756060706s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241020941 (24h6m7.756123517s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241505639 (24h6m7.756608224s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.241941247 (24h6m7.757043827s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242332123 (24h6m7.757434708s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242753088 (24h6m7.757855664s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.242898382 (24h6m7.758000967s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243401088 (24h6m7.758503674s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.243854107 (24h6m7.758956705s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244201456 (24h6m7.759304045s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244608042 (24h6m7.75971062s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.244984412 (24h6m7.760086992s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245346432 (24h6m7.760449018s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.245779352 (24h6m7.760881931s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246144583 (24h6m7.761247163s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.246572369 (24h6m7.761674958s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Uploading piece... Aug 8 09:45:33.364941081 (24h6m7.880043667s) [upload=24942]: Next returned nil segment Aug 8 09:45:33.364958550 (24h6m7.880061137s) [upload=24942]: Waiting for error group managing segments... Aug 8 09:45:33.373895698 (24h6m7.888998268s) [noise=true , address=104.36.82.59:4316 , piece_id=S6C7JBJP2IAQVNVX6N5HV6YS767T4KURXVRQMYYM5IG7ZDUXJGEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.375123017 (24h6m7.890225586s) [noise=true , address=104.36.82.58:4291 , piece_id=YRUUIYL4HOPIO7YZNTWUDJLB2QAKRGG2FZ6CNRLKWMTJXFM7Q42A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.376608376 (24h6m7.891710958s) [noise=true , address=104.36.82.6:4893 , piece_id=IVE3J7454ZQ25XMXLQXS7LSAQOB5HRHKQX6XSPHPTO23QEYQCIFQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377226857 (24h6m7.892329422s) [noise=true , address=104.36.82.37:4675 , piece_id=NTOV4KOJATNQC5I6ETAA2C25HDIBIFE4TEYSMDPLQCBV5YHNJBKA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.377823264 (24h6m7.892925843s) [noise=true , address=104.36.82.2:4751 , piece_id=CWGVZF5AN7QYDBYWXZ77S2SPAYKNVLWAIWFMOAONPES7TF2Z7ECA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378376738 (24h6m7.893479304s) [noise=true , address=104.36.82.47:4518 , piece_id=OUVHGSNAVHADJVLJDGXP25HBOINVMSLXKVWJ5VRA46L56GT5GQYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.378929934 (24h6m7.894032497s) [noise=true , address=104.36.82.23:4461 , piece_id=7XAJ3VXY4UBG3H4DFKZ3DIFUOMT755XLOCZX2VVMKX44J6B5VL7A, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379502546 (24h6m7.894605108s) [noise=true , address=104.36.82.46:4490 , piece_id=34DC6UBA55VYOYCDWBTZOSWPJSYY7LXP2A7TCGF5IDTZOLNAMMKQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.379732394 (24h6m7.894834956s) [noise=true , address=104.36.82.18:4399 , piece_id=PGFT6BNKECSMWLAZAY4UGB3T22CAXBVTCNQQIT6BPXJKF5VGYARQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380020859 (24h6m7.895123437s) [noise=true , address=104.36.82.60:4338 , piece_id=BNYKZGBWZZF7E6JSDI37L6QIU5EDD5O6PXT2ROAA7OL6TCWPJV7Q, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380247285 (24h6m7.895349853s) [noise=true , address=104.36.82.9:4011 , piece_id=V4BZ2WI52UVHMRQESC6752H7R2CS3ZL7GMOEWO4MH2UEDEQOIAEA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380655783 (24h6m7.895758359s) [noise=true , address=104.36.82.43:4845 , piece_id=PUQJ7AEUWGTLYD4MP36DLJU6QCAFEZJ6QGOG63CDOGL7R6IF44QA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.380663255 (24h6m7.895765826s) [noise=true , address=104.36.82.45:4910 , piece_id=QIY3T7A37GLYEEZQVVYYVE3J4B33H626AS7ZG6UNHG7YCW5Y5AYQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381275036 (24h6m7.896377617s) [noise=true , address=104.36.82.61:4407 , piece_id=R25X7USA6CPWPEIBFPT7SSDKGENAD3ZHRX3Q2KUIIX2T7JTGZ6TQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.381311926 (24h6m7.896414503s) [seg_pos={0 0}, upload=24942]: Segment reached optimal threshold of 14 pieces. Aug 8 09:45:33.381496675 (24h6m7.896599243s) [noise=true , address=104.36.82.55:4223 , piece_id=THCU7GG2HXNYFOMYG2OEIN3NENSUWNHQBJACVPWVCRHWUIJPFJNA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FijvRUiKwjk3A6yFZxNeLhPQ4bj5cxeEo6mjEs2DtRnK5WJr6): protocol: expected piece hash; context canceled; EOF Aug 8 09:45:33.381713772 (24h6m7.896816341s) [noise=true , address=64.49.13.155:4914 , piece_id=GNTXNM5KUA3A3IPU7BNG7SBDLTCDL73WVIZT4ESOB3T3K3EDFFQQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:35526->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.382970690 (24h6m7.898073259s) [noise=true , address=104.36.82.19:4420 , piece_id=KRU3YHVKPFT3EGZ5JZDP3D5YMPMTD5Z7MWYIREFKORZ5PBXSIUMQ, seg_pos={0 0}, upload=24942]: Done uploading piece. err: <nil> Aug 8 09:45:33.383418984 (24h6m7.898521552s) [noise=true , address=64.49.13.138:4486 , piece_id=I65IEXVW47RDLNALF3T5D2ZJKNGGH2I3MPYGJTBQM3TYWK7QJ5SA, seg_pos={0 0}, upload=24942]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: read tcp 159.223.143.39:49138->64.49.13.138:4486: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 8 09:45:33.383434092 (24h6m7.898536668s) [seg_pos={0 0}, upload=24942]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Aug 8 09:45:33.383521671 (24h6m7.898624248s) [upload=24942]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:45:33.383527482 (24h6m7.898630059s) [upload=24942]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:45:33.439208503 (24h6m7.954311077s) [upload=24942]: Done uploading segments... Aug 8 09:45:33.439234033 (24h6m7.954336597s) [upload=24942]: Upload finished. err: <nil> Aug 8 09:45:52.807400465 (24h6m27.322503034s) [upload=24946]: Starting upload Aug 8 09:45:52.807484609 (24h6m27.322587186s) [upload=24946]: Done starting upload Aug 8 09:45:52.807651751 (24h6m27.322754326s) [upload=24946]: Uploading segments... Aug 8 09:45:52.808057256 (24h6m27.323159832s) [upload=24946]: Got next segment. Inline: false Aug 8 09:45:52.808103194 (24h6m27.32320577s) [upload=24946]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:45:52.808108266 (24h6m27.323210845s) [upload=24946]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:45:52.815961170 (24h6m27.331063747s) [upload=24946]: Next segment err: metaclient: Too Many Requests Aug 8 09:45:52.815981234 (24h6m27.331083815s) [upload=24946]: Done uploading segments... Aug 8 09:45:52.816000021 (24h6m27.331102591s) [upload=24946]: Upload finished. err: metaclient: Too Many Requests Duration: 1.299065512s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 187.598873ms FAIL (2025-08-08 09:59:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 187.628017ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 187.545719ms FAIL (2025-08-08 09:59:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== 631278088s) [upload=24311]: Done uploading segments... Aug 8 09:09:04.116198138 (23h29m38.631300702s) [upload=24311]: Upload finished. err: <nil> Aug 8 09:10:12.628806771 (23h30m47.143909337s) [upload=24328]: Starting upload Aug 8 09:10:12.628852142 (23h30m47.143954729s) [upload=24328]: Done starting upload Aug 8 09:10:12.628912285 (23h30m47.144014851s) [upload=24328]: Uploading segments... Aug 8 09:10:12.628950870 (23h30m47.144053452s) [upload=24328]: Got next segment. Inline: true Aug 8 09:10:12.628955825 (23h30m47.144058402s) [upload=24328]: Waiting for error group managing segments... Aug 8 09:10:12.628994713 (23h30m47.144097279s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.628999112 (23h30m47.144101689s) [upload=24328]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.629002255 (23h30m47.144104832s) [upload=24328]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.685831086 (23h30m47.200933651s) [upload=24328]: Done uploading segments... Aug 8 09:10:12.685851486 (23h30m47.200954064s) [upload=24328]: Upload finished. err: <nil> Aug 8 09:10:27.940383711 (23h31m2.455486297s) [upload=24332]: Starting upload Aug 8 09:10:27.940446552 (23h31m2.455549137s) [upload=24332]: Done starting upload Aug 8 09:10:27.940523980 (23h31m2.455626556s) [upload=24332]: Uploading segments... Aug 8 09:10:27.940560661 (23h31m2.455663246s) [upload=24332]: Got next segment. Inline: true Aug 8 09:10:27.940565526 (23h31m2.455668103s) [upload=24332]: Waiting for error group managing segments... Aug 8 09:10:27.940611361 (23h31m2.455713937s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:27.940617872 (23h31m2.455720449s) [upload=24332]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:27.940622586 (23h31m2.455725155s) [upload=24332]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:28.000878268 (23h31m2.515980853s) [upload=24332]: Done uploading segments... Aug 8 09:10:28.000896319 (23h31m2.515998905s) [upload=24332]: Upload finished. err: <nil> Aug 8 09:11:32.625115150 (23h32m7.140217719s) [upload=24354]: Starting upload Aug 8 09:11:32.625189349 (23h32m7.140291936s) [upload=24354]: Done starting upload Aug 8 09:11:32.625542418 (23h32m7.140644995s) [upload=24354]: Uploading segments... Aug 8 09:11:32.625645583 (23h32m7.14074817s) [upload=24354]: Got next segment. Inline: true Aug 8 09:11:32.625652852 (23h32m7.140755429s) [upload=24354]: Waiting for error group managing segments... Aug 8 09:11:32.625703584 (23h32m7.140806172s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:32.625710535 (23h32m7.140813115s) [upload=24354]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:32.625714474 (23h32m7.140817156s) [upload=24354]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:32.698236482 (23h32m7.213339068s) [upload=24354]: Done uploading segments... Aug 8 09:11:32.698259414 (23h32m7.21336199s) [upload=24354]: Upload finished. err: <nil> Aug 8 09:12:36.037872861 (23h33m10.552975446s) [upload=24373]: Starting upload Aug 8 09:12:36.037940114 (23h33m10.553042694s) [upload=24373]: Done starting upload Aug 8 09:12:36.038014420 (23h33m10.553116996s) [upload=24373]: Uploading segments... Aug 8 09:12:36.038062195 (23h33m10.553164785s) [upload=24373]: Got next segment. Inline: true Aug 8 09:12:36.038070940 (23h33m10.553173521s) [upload=24373]: Waiting for error group managing segments... Aug 8 09:12:36.038117010 (23h33m10.553219587s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:36.038122277 (23h33m10.553224855s) [upload=24373]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:36.038125953 (23h33m10.55322853s) [upload=24373]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:36.123678491 (23h33m10.638781082s) [upload=24373]: Done uploading segments... Aug 8 09:12:36.123717917 (23h33m10.638820497s) [upload=24373]: Upload finished. err: <nil> Aug 8 09:13:13.475859385 (23h33m47.990961962s) [upload=24386]: Starting upload Aug 8 09:13:13.475949311 (23h33m47.991051897s) [upload=24386]: Done starting upload Aug 8 09:13:13.476028681 (23h33m47.991131258s) [upload=24386]: Uploading segments... Aug 8 09:13:13.476079485 (23h33m47.991182071s) [upload=24386]: Got next segment. Inline: true Aug 8 09:13:13.476086072 (23h33m47.991188653s) [upload=24386]: Waiting for error group managing segments... Aug 8 09:13:13.476137545 (23h33m47.991240123s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:13.476143726 (23h33m47.991246306s) [upload=24386]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:13.476148576 (23h33m47.991251155s) [upload=24386]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:13.546002160 (23h33m48.061104725s) [upload=24386]: Done uploading segments... Aug 8 09:13:13.546023353 (23h33m48.06112593s) [upload=24386]: Upload finished. err: <nil> Aug 8 09:13:48.037909509 (23h34m22.553012101s) [upload=24396]: Starting upload Aug 8 09:13:48.037984376 (23h34m22.553086963s) [upload=24396]: Done starting upload Aug 8 09:13:48.038068985 (23h34m22.553171555s) [upload=24396]: Uploading segments... Aug 8 09:13:48.038182030 (23h34m22.553284607s) [upload=24396]: Got next segment. Inline: true Aug 8 09:13:48.038198860 (23h34m22.553301436s) [upload=24396]: Waiting for error group managing segments... Aug 8 09:13:48.038270587 (23h34m22.553373153s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:13:48.038277319 (23h34m22.553379897s) [upload=24396]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:13:48.038281548 (23h34m22.553384138s) [upload=24396]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:13:48.101216767 (23h34m22.616319332s) [upload=24396]: Done uploading segments... Aug 8 09:13:48.101238227 (23h34m22.61634079s) [upload=24396]: Upload finished. err: <nil> Aug 8 09:14:25.938952399 (23h35m0.454054982s) [upload=24408]: Starting upload Aug 8 09:14:25.939048320 (23h35m0.454150896s) [upload=24408]: Done starting upload Aug 8 09:14:25.939118898 (23h35m0.454221474s) [upload=24408]: Uploading segments... Aug 8 09:14:25.939153745 (23h35m0.45425633s) [upload=24408]: Got next segment. Inline: true Aug 8 09:14:25.939158568 (23h35m0.454261144s) [upload=24408]: Waiting for error group managing segments... Aug 8 09:14:25.939198365 (23h35m0.454300941s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:25.939203010 (23h35m0.454305586s) [upload=24408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:25.939206195 (23h35m0.454308772s) [upload=24408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:26.013142124 (23h35m0.528244718s) [upload=24408]: Done uploading segments... Aug 8 09:14:26.013162841 (23h35m0.528265409s) [upload=24408]: Upload finished. err: <nil> Aug 8 09:14:43.825170700 (23h35m18.340273277s) [upload=24412]: Starting upload Aug 8 09:14:43.825228805 (23h35m18.340331381s) [upload=24412]: Done starting upload Aug 8 09:14:43.825398850 (23h35m18.340501418s) [upload=24412]: Uploading segments... Aug 8 09:14:43.825514343 (23h35m18.340616919s) [upload=24412]: Got next segment. Inline: true Aug 8 09:14:43.825534252 (23h35m18.340636828s) [upload=24412]: Waiting for error group managing segments... Aug 8 09:14:43.825572874 (23h35m18.34067545s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:43.825576626 (23h35m18.340679201s) [upload=24412]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:43.825578822 (23h35m18.340681397s) [upload=24412]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:43.894515423 (23h35m18.409617989s) [upload=24412]: Done uploading segments... Aug 8 09:14:43.894534825 (23h35m18.409637402s) [upload=24412]: Upload finished. err: <nil> Aug 8 09:15:18.241946075 (23h35m52.757048652s) [upload=24423]: Starting upload Aug 8 09:15:18.242004106 (23h35m52.757106693s) [upload=24423]: Done starting upload Aug 8 09:15:18.242084937 (23h35m52.757187515s) [upload=24423]: Uploading segments... Aug 8 09:15:18.242139043 (23h35m52.757241632s) [upload=24423]: Got next segment. Inline: true Aug 8 09:15:18.242145208 (23h35m52.757247786s) [upload=24423]: Waiting for error group managing segments... Aug 8 09:15:18.242203828 (23h35m52.757306404s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:18.242208532 (23h35m52.757311098s) [upload=24423]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:18.242211723 (23h35m52.757314289s) [upload=24423]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:18.300606940 (23h35m52.815709507s) [upload=24423]: Done uploading segments... Aug 8 09:15:18.300624400 (23h35m52.815726966s) [upload=24423]: Upload finished. err: <nil> Aug 8 09:16:28.830702822 (23h37m3.345805613s) [upload=24441]: Starting upload Aug 8 09:16:28.830763102 (23h37m3.345865687s) [upload=24441]: Done starting upload Aug 8 09:16:28.830832997 (23h37m3.345935564s) [upload=24441]: Uploading segments... Aug 8 09:16:28.830870399 (23h37m3.345972984s) [upload=24441]: Got next segment. Inline: true Aug 8 09:16:28.830875334 (23h37m3.345977902s) [upload=24441]: Waiting for error group managing segments... Aug 8 09:16:28.830927450 (23h37m3.346030028s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.830932686 (23h37m3.346035264s) [upload=24441]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.830935683 (23h37m3.346038261s) [upload=24441]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.913610050 (23h37m3.428712636s) [upload=24441]: Done uploading segments... Aug 8 09:16:28.913649371 (23h37m3.428751942s) [upload=24441]: Upload finished. err: <nil> Duration: 187.572959ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)