You may stop the payments that are automatically deducted from your Discover credit card by contacting the customer service number at 1-800-347-2683. You will, however, be unable to take use of some of the perks. You won't need to worry about forgetting to make a payment or about making the payment late if you have it set up so that it is paid automatically.