Use disc with a "c" when you are referring to optical media such as a CD or DVD. All discs are removable, meaning when you eject the disc from your desktop, it physically comes out of your computer. 

Use disk with a "k" for magnetic media, such as a floppy disk, the disk in your computer's hard drive, an external hard drive.