Hepatocellular carcinoma (HCC) contributes to more than 80% of all primary cancers globally and ranks fourth in cancer-related deaths, due to the lack of an effective, definite therapeutic drug. Coleus vettiveroides (CV) has been used in Indian traditional medicine to treat diabetes, liver ailments, skin diseases, leukoderma, and leprosy. This study investigates the anticancer effect of CV ethanolic root extract in HepG2 cells. HepG2 cells were treated with CV extract, and its cytotoxicity was analyzed by MTT assay. AO/EB staining, propidium iodide staining, DCFH-DA assay, phalloidine staining, flow cytometry, and qPCR studies were performed for ROS expression, apoptosis and cell cycle analysis. The phytochemical analysis confirmed the presence of quercetin and galangin in CV root extract. The results showed that CV inhibited the proliferation of HepG2 cells, with altered cellular and nuclear morphology. CV was also found to increase intracellular ROS levels and oxidative stress markers in HepG2 cells. CV significantly altered the actin microfilament distribution in HepG2 cells and caused cell cycle arrest at the sub G -G phase. CV also induced mitochondria-mediated apoptosis, as evidenced by increased expression of p53, Bax, cytochrome C, Apaf-1, PARP, caspase-3 and caspase-9, and downregulated Bcl-2 expression. Therefore, CV exerts its anticancer effect by inducing mitochondrial dysfunction, oxidative stress, cytoskeletal disorganization, cell cycle arrest, and mitochondria-mediated apoptosis, and it could be a potent therapeutic option for HCC.© 2023 John Wiley & Sons Ltd.