While still hot, mash the sweet potatoes. Add the butter, honey, and lemon juice and mix well. While keeping an eye on the thickness, add the milk. You want the mixture to be thick enough for you to be able to form it into balls with your hands. It should take about 1 tablespoon of milk.