Flow chart recognition using Machine learning.

[narayan123411]

Select Topic Area

General

Body

Hello Everyone,
I need your help to create a model which can recognize the flowchart image and in the output it can summarize what this flowchart does. also, i'm new in AI and ML and i understand this is gonna be hard but if you guys can help me with this please.

[arafajs]

Here are a few suggestions for creating a model to recognize and summarize flowchart images:

1. Use a convolutional neural network (CNN) for image recognition. CNNs are very effective for image classification and object detection in images. You would need a dataset of flowchart images to train the CNN to recognize the different shapes and symbols used in flowcharts.
2. For the CNN architecture, you could start with a pretrained model like ResNet or VGGNet, then retrain the last layer(s) on your flowchart dataset. This allows the model to leverage features learned from a much larger image dataset.
3. Each flowchart symbol (rectangle, diamond, arrow etc.) could be treated as a different class label for classification. The model would identify which symbols are present and their spatial relationships.
4. For summarizing the flowchart, you could take a sequence modeling approach. Encode the spatial positions and class labels of symbols as a sequence. Then train a recurrent neural network model to generate a text summary given the symbolic sequence as input.
5. A large labeled dataset of flowchart images and matching text summaries would be needed to train the sequence model. You may need to manually create and label examples to get started.
6. Evaluate the models using accuracy metrics like classification accuracy for the CNN model and BLEU, ROUGE or other language generation metrics for the sequence model.

The main challenges will be generating sufficient training data and developing an effective sequence modeling architecture. But with sufficient data and model tuning, an end-to-end flowchart recognition and summarization system should be possible.

[michaelkariv]

I was googling for a software that does that, and stumbled upon this research article, seem to discuss exactly what you need
https://www.mdpi.com/1099-4300/24/3/425

[narayan123411]

@arafajs Thank you for your clarification I was Building some other project and completely missed your comment. But sure I'll implement these changes.

[Yogesh7090]

i don't need to summarize, i need a source for detecting flowchart from pdf and extract and save it as image.