Is it ok to cook and eat slightly soft potatoes?  

Yes, it’s OK to bake or boil slightly soft potatoes. I am assuming they don’t have large sprouts (if you can knock off the sprouts with your finger or a brush that’s fine too).  Potatoes are 80% water on average, so some of that moisture drying up is natural.