In a mixing bowl toss the cherries and kirsch, cover and let sit for 15 minutes. Shake the bowl every 5 minutes to coat the cherries.
In a sauté pan add the cherry mixture, brown sugar, vanilla, lemon juice, and lemon zest. Bring to a boil and cook for 5 minutes.
Remove the pan from the heat and add the bourbon. Using a long match or a utility lighter to light the bourbon. Allow the flames to completely die down, about 2-3 minutes.