feat: Implement taxonomy sample data generation

[yusuf-musleh]

Description

Implements generating sample taxonomy data to be used for testing and development. Repeating what is already mentioned in the README:

Running this script will do the following:

1. 2 Test Organizations will be created
2. For each organization created, a sample course is created that is populated with a course export that contains a variety of section/subsections/units and components
3. For each of these created organizations the following taxonomies will be created:
   1. a disabled taxonomy with 10 Tags
   2. an enabled flat taxonomy with 5000 Tags
   3. an enabled hierarchical taxonomy with three levels and 4^x tags per level (4 root tags, each with 16 child tags, each with 64 grandchild tags)
   4. a small enabled taxonomy with 2 levels with 2 Tags each
4. A multi org Taxonomy is created and enabled/used by both orgs
5. (Optional) A 4 level Taxonomy containing data obtained from Open Canada Taxonomy
6. (Optional) A 3 level Taxonomy containing data obtained from LightCast Skills Taxonomy
7. Once the Taxonomies and their Tags have been created, the script will Tag each of the courses along with all the components they contain with 1 of each Tag from the the above

Note: This script is designed to be idempotent. Meaning that the end state is the same every time you run it. So if you make modifications to the sample courses on Studio or the Taxonomy data in the shell and run this script again, it will reset all your changes.

Related Tickets:

• Closes [Tagging] Sample taxonomy and org data openedx/modular-learning#107

Testing Instructions

Similar to what is mentioned in the README:

1. To begin, clone this repo inside a directory so it can be accessed from within the devstack (eg: /edx/src/)

2. Set the TAXONOMY_SAMPLE_PATH variable inside the generate.py file to point to the cloned repo inside your devstack/tutor environment, eg: /edx/src/taxonomy-sample-data

3. (Optional) If you would not like to include taxonomy data from real world examples, such as:

   • Open Canada Taxonomy
   • LightCast Skills Taxonomy

   Then set the following flags to False in generate.py accordingly:

   IMPORT_OPEN_CANADA_TAXONOMY = True
   IMPORT_LIGHTCAST_SKILLS_TAXONOMY = True

4. To run the script, enter the LMS shell (make lms-shell) and run the following command:

   python manage.py cms shell < /path/to/taxonomy-sample-data/generate.py

5. The script should run to completion, you'll notice it tagging the courses + components in the logs of the script

---

Private-ref: FAL-3516

[bradenmacdonald]

Hmm, I guess I forgot to point out that we already have an import-export API for taxonomies that can import JSON files? 😬 https://github.com/openedx/openedx-learning/tree/main/openedx_tagging/core/tagging/import_export

Not a big deal, but it would have been nice to re-use the existing import code and JSON file format. No need to change now though, we need to wrap this up.

[yusuf-musleh]

Oh my bad 😅 didn't know we had that. I can address that in a future ticket for sure.

[bradenmacdonald]

Generally looks great, thanks! I'll try to test this tomorrow; didn't get time today. If you can make the path customizeable in the meantime, that will make it easier for me to test since I don't use devstack.

[bradenmacdonald]

Looks great and seems to have worked well! A couple notes:

[bradenmacdonald]

BTW I also had to change the default user name, because there are no standard users on Tutor devstacks. So the first time I ran it, I saw an error about UserDoesNotExist, but I fixed it easily by changing the variable.

[yusuf-musleh]

BTW I also had to change the default user name, because there are no standard users on Tutor devstacks. So the first time I ran it, I saw an error about UserDoesNotExist, but I fixed it easily by changing the variable.

Oh I see, I thought edx@example.com was a universally available user. I added a note in the README for folks to modify if needed.

[bradenmacdonald]

👍

• I tested this: imported it into my devstack
• I read through the code
• I checked for accessibility issues: n/a
• Includes documentation: README

[bradenmacdonald]

@pomegranited @rpenido @ChrisChV Please check out this nice work from @yusuf-musleh! I'd like everyone working on the taxonomy project to import these taxonomies/courses/tags into their devstack please. In FAL-3531 we will soon put these onto the sandbox too.