There are plenty of studies displaying improved cardiovascular health in those who drink 1-4 cups of coffee a day.. Generally, cardiovascular risks of caffeine from coffee are not important for the average person’s health decisions.

In addition, there is a good argument for caffeine prior to exercise - it improves performance and therefore results and therefore health outcomes.

Also tea has caffeine as well (technically dark chocolate too, but less than tea so not really a concern).

And again, the solution to sleep issues are to not have caffeine (tea, coffee, or otherwise) more than a few hours after you wake up.

Withdrawal symptoms are not a major concern - they are temporary at best.

Edit: there are plenty of sources of polyphenols - but frankly the average American does not get nearly enough generally. If you have a typical American diet, I would not recommend quitting coffee as a health measure unless you have already drastically increased consumption of polyphenols generally.