In a medium pot, bring the water to a boil over medium heat. Remove the pot from the heat and add the tea. Let the mixture steep for 5 to 6 minutes. Strain out the loose tea.
Return the tea mixture to the pot and then stir in the milk, honey and sugar. Heat, stirring occasionally, until the sugar is dissolved.
Remove the pot from the heat and stir in the bourbon and vanilla extract.
Divide the mixture among four mugs and garnish each with a pinch or two of cinnamon. Serve immediately.
Optional: add a cinnamon stick or star anise for a garnish