Heat the oven to 350°F and coat a 9x5-inch or 10-inch loaf pan with butter and flour, or use baking spray. Cover the bottom, corners, and sides evenly to help the baked loaf release.
Combine the flour, baking powder, baking soda, salt, nutmeg, and cinnamon in a medium mixing bowl, using a whisk to break up clumps and distribute everything. The dry mixture should look uniform, without visible streaks of spice.
Whisk the eggnog, sugar, oil, vanilla extract, rum extract, and eggs in another bowl, then gently incorporate this mixture into the dry ingredients. Stop when the batter is evenly moistened and pourable, with no dry flour pockets.
Transfer the batter to the prepared pan, distribute it evenly, and bake for 50–60 minutes. Look for a golden-brown top and a toothpick or cake tester that emerges clean from the center.
Leave the loaf in its pan for 20 minutes before turning it out onto a cooling rack. Let it reach room temperature so the crumb firms up for cleaner slicing.
Whisk the powdered sugar, vanilla extract, nutmeg, and enough of the measured eggnog in a small bowl to make a drizzle, then slowly apply all the glaze over the loaf in repeated passes. The glaze should fall in a ribbon and cling to the surface rather than immediately running off.
Refrigerate the bread in an airtight container or enclosed in plastic wrap. Keep the wrapping snug or the lid firmly closed to protect the crumb from drying out.