Prickly and prevalent, holly bushes return with a vengeance if you simply cut the top off the bush. To completely rid yourself of the bush, you must dig it up. This method, though requiring more physical labor, produces more instantaneous results than using a weed killer on the stump. Digging up the plant will protect nearby plants from damage incurred from using a herbicide.
Cut off the leaves and branches of the holly bush with a hedge trimmer or shears.
Saw the main stem (trunk) as close to the ground as possible with a wood saw.
Push the end of a shovel into the ground 2 feet away from the stump.
Create a ring around the holly bush by pushing the shovel into the ground 2 feet from the stump of the holly bush.
Dig 1 to 2 feet down into the ground within this ring around the bush stump, using the end of the shovel to cut through any roots you encounter.
Lift the base of the stump from the center of the circle as soon as you can get your shovel under its base.
Discard the parts of the holly bush with other yard waste.