RE01

This repository includes the Python code for our paper "Machine learning approaches for improving near-real-time IMERG rainfall estimates by integrating Cloud Properties from NOAA CDR PATMOSX". DOI: https://doi.org/10.1175/JHM-D-21-0019.1

Abstract： The Global Precipitation Measurement (GPM) mission provides satellite precipitation products with an unprecedented spatio-temporal resolution and spatial coverage. However, its near-real-time (NRT) product still suffers from low accuracy. This study aims to improve the early run of the Integrated Multi-satellitE Retrievals for GPM (IMERG) by using four machine learning approaches, i.e., support vector machine (SVM), random forest (RF), artificial neural network (ANN), and Extreme Gradient Boosting (XGB). The cloud properties are selected as the predictors in addition to the original IMERG in these approaches. All the four approaches show similar improvement, with 53%-60% reduction of root-mean-square error (RMSE) compared with the original IMERG in a humid area, i.e., the Dongjiang River Basin (DJR) in southeastern China. The improvements are even greater in a semi-arid area, i.e., the Fenhe River Basin (FHR) in central China, the RMSE reduction ranges from 63%-66%. The products generated by the machine learning methods performs similarly to or even outperform than the final run of IMERG. Feature importance analysis, a technique to evaluate input features based on how useful they are in predicting a target variable, indicates that the cloud height and the brightness temperature are the most useful information in improving satellite precipitation products, followed by the atmospheric reflectivity and the surface temperature. This study shows that a more accurate NRT precipitation product can be produced by combining machine learning approaches and cloud information, which is of importance for hydrological applications that requires NRT precipitation information including flood monitoring.

The framework can be shown as:

All the codes have been submitted and processed data will be provided after article published. Also, raw data can be avaliable freely by runing the function "GEE_download" in the code "Data_processed.py".

Under construction. Will come back soon...