In a large mixing bowl, combine the cooled brown butter, granulated sugar, and brown sugar. Beat for approximately 2 minutes until well combined.
Add the eggs one at a time, mixing well after each addition. Add the vanilla bean paste and mix until incorporated.
In a separate bowl, whisk together the flour, baking powder, baking soda, cinnamon, nutmeg or pumpkin pie spice, and kosher salt.
In another bowl, whisk together the whole milk and sour cream until smooth.
Add approximately one-third of the dry ingredients to the butter mixture and mix on low speed until just combined. Then add half of the milk mixture and mix briefly. Continue alternating the dry ingredients and milk mixture, beginning and ending with the dry ingredients. Mix only until combined.
Transfer the batter to the prepared Bundt pan and spread evenly. Gently tap the pan on the counter to release any large air pockets.
Bake for approximately 45–55 minutes, or until a toothpick inserted into the thickest portion of the cake comes out clean or with a few moist crumbs.