I have never voluntarily ended a business relationship with a client because they were too difficult from a project management standpoint.

I have heard stories that separating and discarding bad clients from your CRM, you will be able to focus more time and energy on maintaining the good clients that you have.

Seth Godin has some experience in this arena so I invite you to check out his blog post, Unreasonable Clients, to hear his story.