Salidroside is reported to have a wide range of pharmacological properties and has been proven to play a key anti-cancer effect. This study investigated the effects of purified salidroside, an ingredient of Rhodiola rosea, on the proliferation of two human gastric cancer cell lines and further investigating its possible molecular mechanisms. We verified that salidroside exerts a dose-dependent inhibitory effect on the proliferation of SGC-7901 and MKN-45 human gastric cancer cells. Moreover, salidroside can induce cell apoptosis, which was accompanied by an increase in nuclear fragmentation. In addition, salidroside inhibited glycolysis, as evidenced by the reduced expression levels of the glycolysis-related enzymes pyruvate kinase isoenzyme M2 (PKM2), enolase 1 (ENO1) and glucose transporter 1 (GLUT1), which could play important roles in the metabolism of gastric cancer cells. Further investigation showed that salidroside exerted potent anti-proliferative effects by inhibiting glycolysis in human gastric cancer cells in vitro. In vivo, xenograft tumors treated with salidroside were significantly smaller than those in the control animals. Therefore, salidroside could be a promising therapeutic prospect in the treatment of gastric cancer.