In a large bowl, beat cooled sugar mixture, cream cheese, and remaining ½ cup butter with a mixer at medium speed until smooth and creamy. Reduce speed to low, and gradually add confectioners’ sugar, beating until smooth. If frosting is too thick to spread, beat in milk, 1 tablespoon at a time, to achieve a spreadable consistency. Use immediately.