Whether or not your gas giant heats up to the point that it ignites and turns into a small star depends largely on how much acceleration you're trying to get out of your candle. Remember, slow and steady wins the race!
Addendum to Note: Larry Niven suggested that such an arrangement could be used to move rocky worlds from one orbit to another, and he wrote a novel entitled A World Out of Time in which the Earth was moved with the help of giant candle they'd shoved up Uranus. I'm not making this up.