Go to a place that has a garden center and tell them you need an herbicide that will kill woody plant material.

There's a product called BrushBGone by Ortho that works. That combined with Roundup should do the trick. I would be sure to cut as much of the plant back first to make sure you expose the roots. The containers come with pumps!