Abnormal protein aggregation has been intensively studied for over 40 years and broadly discussed in the literature due to its significant role in neurodegenerative diseases etiology. Structural reorganization and conformational changes of the secondary structure upon the aggregation determine aggregation pathways and cytotoxicity of the aggregates, and therefore, numerous analytical techniques are employed for a deep investigation into the secondary structure of abnormal protein aggregates. Molecular spectroscopies, including Raman and infrared ones, are routinely applied in such studies. Recently, the nanoscale spatial resolution of tip-enhanced Raman and infrared nanospectroscopies, as well as the high sensitivity of the surface-enhanced Raman spectroscopy, have brought new insights into our knowledge of abnormal protein aggregation. In this review, we order and summarize all nano- and micro-spectroscopic marker bands related to abnormal aggregation. Each part presents the physical principles of each particular spectroscopic technique listed above and a concise description of all spectral markers detected with these techniques in the spectra of neurodegenerative proteins and their model systems. Finally, a section concerning the application of multivariate data analysis for extraction of the spectral marker bands is included.