Refrigerate the assembled casserole for at least 4 hours or overnight to allow the bread to soak up the custard. Let the dish sit 15 to 30 minutes at room temperature before baking. If the glaze is too thick, thin it with additional milk 1 teaspoon at a time.