Hi Jimbo,

Yes...the wisdom tooth probably should come out. The bacteria does get in underneath that flap of skin and there is a good likelihood that an infection is brewing there. The reason it has not swelled up is because it is open and the bacteria is draining. But that flap of tissue can become inflamed to the point that it closes over and then a huge swelling will occur.
When the bacteria migrates down in to the bone it will cause the tooth in front of it to decay along the root surface. Which would mean that both teeth would then have to be removed. So it's worth losing the wisdom tooth which is bothersome and a source of infection to avoid losing both of them sometime in the near future.

You said the site of #20 is still painful. Has the pain increased over the last 2 days? Are you rinsing with warm salt water? Do not use any mouthwash as this will irritate the surgical wound and contribute to cause a dry socket. Also, if you smoke.... stop because that too will cause all sorts of painful problems.

Bryanna