Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train 3D nnU-Net on segmentation results of 2D nnU-Net #37

Closed
4 tasks done
plbenveniste opened this issue Jun 16, 2023 · 2 comments
Closed
4 tasks done

Train 3D nnU-Net on segmentation results of 2D nnU-Net #37

plbenveniste opened this issue Jun 16, 2023 · 2 comments
Assignees

Comments

@plbenveniste
Copy link
Collaborator

plbenveniste commented Jun 16, 2023

  • Pre-process and transform data to the nnU-Net format
  • Train and test 3D nnU-Net
  • Visual analysis of the results
  • Comparison with the results of the 2D nnU-Net

Related to #36

@plbenveniste plbenveniste self-assigned this Jun 16, 2023
@plbenveniste
Copy link
Collaborator Author

  • Created a python script to convert predictions back to the zurich_mouse dataset format
  • Uploaded data on the romane server
  • Currently running 3d_fullres training on romane gpu cluster 3 (estimated end time: June 20th at 10 am)

@plbenveniste
Copy link
Collaborator Author

plbenveniste commented Jun 20, 2023

Training completed:

  • Trained on all data using segmentations from 2D nnU-Net trained on extracted slice
  • 1000 iterations
  • 5 folds
  • 3d fullres
  • Pseudo-Dice: 0.9

Observations (Comparison with segmentations using 2D nnU-Net):

  • n°1, 2, 3, 5, 7, 8, 9, 10, 12, 13, 15, 18, 20: Similar result: new segmentation is more stable and contains less "noise"
    Example (image n°5):
    comparison of quality
    It shows that the annotations are more homogenous from slice to slice: advantage of going from 2D to 3D.

  • n°4, 6, 11, 14, 17, 19: bad results in both case
    Example (n°6)
    Screen Shot 2023-06-20 at 12 45 28 PM
    The model learned to segment outside of the spinal cord.

General observation:

  • in segmentation at the top or bottom of the volume of slice, the model tends not to label the entirety of the white matter. (the following example comes from n°14)
    image

Suggestion for further improvement:

  • Look at correlations between the type of chunk and the quality of the segmentation (cf image from bad example: usually this type of volume)
  • Retrain the 2D model with more annotations on slices at the top/bottom of the volume to improve the quality of the segmentation in these areas and more annotations on types of volume which fail
  • Observe the results ans select good annotations
  • Retrain 3D model on these annotations only
  • Observe results and conclude

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant