Question on m2t-motionGPT evaluation metrics

[OrigamiStationery]

Thank u for your grand project. It really helps a lot. But now I'm in trouble evaluating the task-specific motionGPT to tackle with motion translation. It seems that when the model is training on m2t task, it still uses the metrics used to evaluate t2m task, which throws an exception below:
lightning_fabric.utilities.exceptions.MisconfigurationException: ModelCheckpoint(monitor='Metrics/FID')could not find the monitored key in the returned metrics: ['epoch', 'step', 'gpt/loss/train', 'total/train', 'Metrics/Matching_score', 'Metrics/gt_Matching_score', 'Metrics/R_precision_top_1', 'Metrics/R_precision_top_2', 'Metrics/R_precision_top_3', 'Metrics/gt_R_precision_top_1', 'Metrics/gt_R_precision_top_2', 'Metrics/gt_R_precision_top_3', 'Metrics/Bleu_1', 'Metrics/Bleu_2', 'Metrics/Bleu_3', 'Metrics/ROUGE_L', 'Metrics/CIDEr', 'Metrics/Bleu_4', 'Metrics/Bert_F1']. HINT: Did you calllog('Metrics/FID', value)in theLightningModule?
I think it might be something wrong in my config file but I don't know how to solve it. desperate for your help OTZ.
btw express my sincere gratitude again.

[billl-jiang]

Hello,

Thank you for your kind words about the project, and I'm sorry to hear you're encountering issues with evaluating the motionGPT for the motion translation (m2t) task. The problem you're facing with the metrics seems to stem from the task configuration in your model.

For training on the m2t task, it's essential to adjust the validation task to m2t within your configuration file. This can be achieved by setting model.task to m2t in your config file. This adjustment ensures that the appropriate metrics are used for evaluation during the m2t task training.

I hope this helps resolve the issue. Your gratitude is greatly appreciated, and please don't hesitate to reach out if you have further questions.

MotionGPT/configs/config_h3d_stage2.yaml

Lines 49 to 53 in a56b09f

	model:
	target: mGPT.models.mgpt.MotionGPT
	params:
	condition: 'text'
	task: 't2m'

[Skye601]

I have set the task to m2t in stage2.yaml, but I still encountered this problem.