retdec-fileinfo runs over a minute and uses 40 GB of RAM to analyze a 46 MB PE file

[s3rvac]

retdec-fileinfo runs over a minute and uses 40 GB of RAM to analyze a 46 MB PE file

Steps to reproduce

On Linux, run

$ /usr/bin/time -v retdec-fileinfo FILE

where FILE is 93BFA7B15B780AC44C0500C127DACC2B69C29AEC94FB2F63D684F68DF4A40F5C.

Expected output

The file is analyzed in a reasonable time and using a reasonable amount of memory.

Actual output

$ /usr/bin/time -v retdec-fileinfo FILE
[..]
        User time (seconds): 88.79
[..]
        Maximum resident set size (kbytes): 42310212

That is, retdec-fileinfo ran for over a minute and used around 40 GB of memory during the analysis.

Configuration

• Commit: ec5cd88 (current master, including a fix for retdec-fileinfo runs for a minute and uses 110 GB of RAM to analyze a 41 MB PE file #907)
• 64b Debian Buster, GCC 9, Debug build of RetDec

[ladislav-zezula]

#912