Preheat the oven to 350ºF and prepare a cupcake tin with 12 paper liners.
In the bowl of a stand mixer with the paddle attachment, cream the butter and sugar together on medium speed until fluffy.
Add in the eggs and mix together fully, then add the pumpkin puree and the vanilla, beating until fully combined. The mixture might look grainy at this stage, but that's okay!
In a medium bowl, mix the flour, baking powder, pumpkin pie spice, and salt together.
Add the dry ingredients to the wet ingredients and mix together, then add the milk and mix on low speed until combined.
Use a cookie scoop to portion your cupcake batter evenly into each paper liner. Bake the cupcakes for about 20 minutes, or until a toothpick comes out clean. Let the cupcakes cool completely before frosting.