Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the testing time comsumption #49

Open
RuijieJ opened this issue Jun 1, 2020 · 5 comments
Open

About the testing time comsumption #49

RuijieJ opened this issue Jun 1, 2020 · 5 comments

Comments

@RuijieJ
Copy link

RuijieJ commented Jun 1, 2020

According to the original paper, the recognition time for each image is 20ms. I modified demo.py, let it recognize all the images on the ICDAR2003 test set, and computed the average recognition time.

The following is my modification:

image

and the output is

average time = 168.360ms

which is larger than 20ms. I did the recognition on a single NVIDIA Tesla V100 GPU. I don't think using PyTorch will cause so much extra time consumption (I even ignore the time of reading image and preprocessing). So I wonder what is the problem.

Thanks very much.

@ayumiymk
Copy link
Owner

ayumiymk commented Jun 1, 2020

I guess there should be two reasons,

  1. I am not very sure that the 20ms in our paper is whether tested with beam width 1.
  2. The max_len in TF version is 30, see here? But in the pytorch version, 100 is used.

If you want to confirm the first point, you can run our TF code on a single NVIDIA TITAN Xp GPU with different beam widths.

@RuijieJ
Copy link
Author

RuijieJ commented Jun 28, 2020

I guess there should be two reasons,

  1. I am not very sure that the 20ms in our paper is whether tested with beam width 1.
  2. The max_len in TF version is 30, see here? But in the pytorch version, 100 is used.

If you want to confirm the first point, you can run our TF code on a single NVIDIA TITAN Xp GPU with different beam widths.

Thanks. I found the slow test speed is caused by the first test sample. It took a long time to recognize the first sample, and the following samples will become faster. I ignore the test time of the first sample, and the average test time is 48ms (with beam width 1 and max_len 25). Although it is still larger than 20ms, it is acceptable.

@mengxiaolu
Copy link

I guess there should be two reasons,

  1. I am not very sure that the 20ms in our paper is whether tested with beam width 1.
  2. The max_len in TF version is 30, see here? But in the pytorch version, 100 is used.

If you want to confirm the first point, you can run our TF code on a single NVIDIA TITAN Xp GPU with different beam widths.

我想应该有两个原因,

  1. 我不太确定论文中的20毫秒是否经过1毫米的光束宽度测试。
  2. TF版本中的max_len是30,请看这里?但是在pytorch版本中,使用了100。

如果要确认第一点,则可以在具有不同光束宽度的单个NVIDIA TITAN Xp GPU上运行我们的TF代码。

谢谢。我发现测试速度慢是由第一个测试样本引起的。花了很长时间才能识别出第一个样本,随后的样本会变得更快。我忽略了第一个样本的测试时间,平均测试时间为48ms(光束宽度为1,max_len为25)。尽管它仍然大于20ms,但是可以接受。

Hello, can the training and test code run through git bash, but can't run on the windows software platform?

Thank you very much.

@ayumiymk
Copy link
Owner

I guess there should be two reasons,

  1. I am not very sure that the 20ms in our paper is whether tested with beam width 1.
  2. The max_len in TF version is 30, see here? But in the pytorch version, 100 is used.

If you want to confirm the first point, you can run our TF code on a single NVIDIA TITAN Xp GPU with different beam widths.

我想应该有两个原因,

  1. 我不太确定论文中的20毫秒是否经过1毫米的光束宽度测试。
  2. TF版本中的max_len是30,请看这里?但是在pytorch版本中,使用了100。

如果要确认第一点,则可以在具有不同光束宽度的单个NVIDIA TITAN Xp GPU上运行我们的TF代码。

谢谢。我发现测试速度慢是由第一个测试样本引起的。花了很长时间才能识别出第一个样本,随后的样本会变得更快。我忽略了第一个样本的测试时间,平均测试时间为48ms(光束宽度为1,max_len为25)。尽管它仍然大于20ms,但是可以接受。

Hello, can the training and test code run through git bash, but can't run on the windows software platform?

Thank you very much.

Sorry, it only runs on Linux.

@lrfighting
Copy link

请问您知道如何在测试时候输出矫正图像吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants