Skip to content

Commit ffe1195

Browse files
authored
update DataParallel in slowfast (PaddlePaddle#5298)
* update DP in slowfast and refine nextvlad doc * refine doc
1 parent 643fd69 commit ffe1195

File tree

5 files changed

+8
-6
lines changed

5 files changed

+8
-6
lines changed

PaddleCV/video/models/nextvlad/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@
1212

1313

1414
## 算法介绍
15-
NeXtVLAD模型是第二届Youtube-8M视频理解竞赛中效果最好的单模型,在参数量小于80M的情况下,能得到高于0.87的GAP指标。该模型提供了一种将桢级别的视频特征转化并压缩成特征向量,以适用于大尺寸视频文件的分类的方法。其基本出发点是在NetVLAD模型的基础上,将高维度的特征先进行分组,通过引入attention机制聚合提取时间维度的信息,这样既可以获得较高的准确率,又可以使用更少的参数量。详细内容请参考[NeXtVLAD: An Efficient Neural Network to Aggregate Frame-level Features for Large-scale Video Classification](https://arxiv.org/abs/1811.05014)
15+
NeXtVLAD模型是第二届Youtube-8M视频理解竞赛中效果最好的单模型,在参数量小于80M的情况下,能得到高于0.87的GAP指标。该模型提供了一种将帧级别的视频特征转化并压缩成特征向量,以适用于大尺寸视频文件的分类的方法。其基本出发点是在NetVLAD模型的基础上,将高维度的特征先进行分组,通过引入attention机制聚合提取时间维度的信息,这样既可以获得较高的准确率,又可以使用更少的参数量。详细内容请参考[NeXtVLAD: An Efficient Neural Network to Aggregate Frame-level Features for Large-scale Video Classification](https://arxiv.org/abs/1811.05014)
1616

1717
这里实现了论文中的单模型结构,使用2nd-Youtube-8M的train数据集作为训练集,在val数据集上做测试。
1818

dygraph/slowfast/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -68,7 +68,7 @@ SlowFast Overview
6868

6969
## 数据准备
7070

71-
SlowFast模型的训练数据采用Kinetics400数据集,数据下载及准备请参考[数据说明](../PaddleCV/video/data/dataset/README.md)
71+
SlowFast模型的训练数据采用Kinetics400数据集,数据下载及准备请参考[数据说明](../PaddleCV/video/data/dataset/README.md)
7272

7373

7474
## 模型训练

dygraph/slowfast/eval.py

+2-1
Original file line numberDiff line numberDiff line change
@@ -101,7 +101,8 @@ def test_slowfast(args):
101101

102102
if args.use_data_parallel:
103103
strategy = fluid.dygraph.parallel.prepare_context()
104-
slowfast = fluid.dygraph.parallel.DataParallel(slowfast, strategy)
104+
slowfast = fluid.dygraph.parallel.DataParallel(
105+
slowfast, strategy, find_unused_parameters=False)
105106

106107
#create reader
107108
test_data = KineticsDataset(mode="test", cfg=test_config)

dygraph/slowfast/predict.py

+2-1
Original file line numberDiff line numberDiff line change
@@ -110,7 +110,8 @@ def infer_slowfast(args):
110110

111111
if args.use_data_parallel:
112112
strategy = fluid.dygraph.parallel.prepare_context()
113-
slowfast = fluid.dygraph.parallel.DataParallel(slowfast, strategy)
113+
slowfast = fluid.dygraph.parallel.DataParallel(
114+
slowfast, strategy, find_unused_parameters=False)
114115

115116
#create reader
116117
infer_data = KineticsDataset(mode="infer", cfg=infer_config)

dygraph/slowfast/train.py

+2-2
Original file line numberDiff line numberDiff line change
@@ -277,8 +277,8 @@ def train(args):
277277

278278
video_model = SlowFast(cfg=train_config, num_classes=400)
279279
if args.use_data_parallel:
280-
video_model = fluid.dygraph.parallel.DataParallel(video_model,
281-
strategy)
280+
video_model = fluid.dygraph.parallel.DataParallel(
281+
video_model, strategy, find_unused_parameters=False)
282282

283283
bs_denominator = 1
284284
if args.use_gpu:

0 commit comments

Comments
 (0)