Breast cancer has become a menacing form of cancer among women accounting for 11.6% of total deaths of 9.6 million due to all types of cancer every year all over the world. Early detection increases chances of survival and reduces the cost of treatment as well. Screening modalities such as mammography or thermography are used to detect cancer early; thus, several lives can be saved with timely treatment. But, there are interpretational failures on the part of the radiologists to read the mammograms or thermograms and also there are interobservational and intraobservational differences between them. So, the degree of variations among the different radiologists in the interpretation of results is very high resulting in false positives and false negatives. The double reading can reduce the human errors involved in the interpretation of mammograms. But, the limited number of medical professionals in developing or underdeveloped countries puts a limitation on this remedial way. So, a computer-aided system (CAD) is proposed to detect the benign cases from the abnormal cases that can result in automatic detection of breast cancer or can provide a double reading in the case of nonavailability of the trained medical professionals in developing economies. The generally accepted screening modality is mammography for the early detection of cancer. But thermography has been tried for early detection of breast cancer in recent times. The high metabolic activity of the cancer cells results in an early change in the temperature profile of the region. This shows asymmetry between normal and cancerous breast which can be detected using different techniques. Thus, this work is focussed on the use of thermography in the early detection of breast cancer. An experimental study is conducted to find the results of classification accuracy to compare the efficacy of thermography and mammography in classifying the normal from abnormal ones and further abnormal ones into benign and malignant cases. Thermography is found to have classification accuracy almost at par with mammography for classifying the cancerous breasts from healthy ones with classification accuracies of thermography and mammography being 96.57% and 98.11%, respectively. Thermography is found to have much better accuracy in identifying benign cases from the malignant ones with the classification accuracy of 92.70% as compared to 82.05% with mammography. This will result in the early detection of cancer. The advantage of being portable and inexpensive makes thermography an attractive modality to be used in economically backward rural areas where mammography is not practically possible.