Abstract: Accurate detection of abnormal cells is essential for early screening and precise diagnosis of cervical cancer. Despite the recent advances in deep learning-based methods for cervical cancer detection, their broad clinical applications are hindered by several technical challenges. On the one hand, gradually evolved abnormal cells are visually similar to normal cells. On the other hand, single cells and cell clusters exhibit significant appearance variations, overlooking those between normal and abnormal cells. In order to overcome these challenges, we propose a novel dual-branch multi-granularity hierarchical contrast and cross attention network, called DMCA-Net. Specifically, DMCA-Net utilizes dual branches to detect abnormal and normal cells, respectively. Meanwhile, an inter-c