In recent years, Madagascar and the Comoros archipelago have been affected by epidemics of Rift Valley fever (RVF), however detection of Rift Valley fever virus (RVFV) in zebu, sheep and goats during the post epidemic periods was frequently unsuccessful. Thus, a highly sensitive real-time RT-PCR assay was developed for the detection of RVFV at low viral loads. A new RVF SYBR Green RT-PCR targeting the M segment was tested on serum from different RVF seronegative ruminant species collected from May 2010 to August 2011 in Madagascar and the Comoros archipelago and compared with a RVF specific quantitative real time RT-PCR technique, which is considered as the reference technique. The specificity was tested on a wide range of arboviruses or other viruses giving RVF similar clinical signs. A total of 38 out of 2756 serum samples tested positive with the new RT-PCR, whereas the reference technique only detected 5 out of the 2756. The described RT-PCR is an efficient diagnostic tool for the investigation of enzootic circulation of the RVF virus. It allows the detection of low viral RNA loads adapted for the investigations of reservoirs or specific epidemiological situations such as inter-epizootic periods.