Colorectal cancers originate in the colon or rectum and the two cancers have a lot in common with the exception of some differences in cancer treatment. Colon and rectal cancers are unique in that they usually always start as a polyp. The non-cancerous polyp changes as years go by, becoming pre-malignant then malignant.