This investigation demonstrates the temperature-dependent mechanical properties of Si80Ge20 alloy films via a nanoindenter in the indentation depth of 100 nm. The roughly equal root mean square roughness (Rrms) values and repeatable load–displacement (P–δ) curves for the samples ensure the mechanical performances mainly contributed from the influences of annealing temperatures. The hardness (H) values of samples increase with the temperatures of an initial annealing in the range from RT to 900 °C, and, conversely, decrease for annealing temperatures over 900 °C. Accordingly, both E/H and hf/hmax values, exhibiting an inverse tendency in the above temperature range, hints that the solid solution strengthening effect and the softening phenomenon occur for the initial-annealing and over-annealing stages, respectively. In addition, grazing incidence X-ray diffraction (GIXRD) analysis demonstrates the lattice expansion and the broadened peak that attribute to the solid solution strengthening of samples and the segregation of Ge, respectively. Through observing the value of the (200) lattice spacing of 5.624 Å for a 900 °C-annealed sample by transmission electron microscopy (TEM) analysis, it is verified that the segregation of Ge is responsible for the decreased hardness for the 1000 °C-annealed sample.