Update search_api_solr drupal module to 8.3

[Natkeeran]

We are currently using 8.2 search_api_solr. Changing to 8.3 needs some work.

• They changed the solr-conf folder name to solr-conf-templates, thus a change is needed here: https://github.com/Islandora-Devops/claw-playbook/blob/master/roles/internal/webserver-app/tasks/solr.yml#L9

• Solr server instance did not start properly. It gave this issue https://www.drupal.org/project/search_api_solr/issues/3040862. I applied the solution suggested in the drupal issue and restarted the solr instance. It came up as normal.

Additional discussions here:
https://groups.google.com/forum/#!topic/islandora/b9XZ-CRnpag

[kayakr]

@Natkeeran FYI, we are using Search API Solr 8.x-3.1 having installed the config.zip files downloaded from the Drupal search admin pages (shows as Schema drupal-8.3.3-solr-7.x).
We needed to override the config to handle ASCII folding for macrons, but apparently the way to do this is via a 'domain'-specific config, see comment at support chat https://drupalchat.me/channel/search?msg=sWxOYxACSAxDn8DLjg
Note that there are numerous Drupal db updates if you're updating an existing instance.

[Natkeeran]

@kayakr

Can you pls share the url for the config.zip?

I kind of get what they are saying. But, not sure how exactly to separate the domain specific config out. Were you able to find out?

[kayakr]

@Natkeeran The config.zip comes from the Drupal Search API module config on your local install, e.g. http://localhost:8000/admin/config/search/search-api/server/default_solr_server

I haven't found any docs re the domain-specific config.

[kayakr]

@Natkeeran The search_api maintainer has pointed me at https://www.drupal.org/docs/8/modules/search-api-solr/howtos-3064550/howto-define-a-new-content-domain and config/optional folder, see https://drupalchat.me/channel/search?msg=EwreJpbykjpq8vKKG

[seth-shaw-unlv]

Instead of using the config download path there is a drush command we can use to get the zip, so getting that working in the playbook shouldn't be too bad.

The additional domain config seems like it should be a recipe rather than a config we ship with. That stated, if you have a config we can use as a reasonable default, @kayakr, we can look at including it in the playbook.

Any reason why we shouldn't also bump SOLR to 8.x?

I might be able to take on some of these updates in early January.

[kayakr]

A fresh playbook VM (as of last week) builds with:

• Search API 8.x-1.13
• Search API Solr 8.x-2.7
• solarium/solarium 4.20

but these should be updated to:

• Search API 8.x-1.15
• Search API Solr 8.x-3.9
• solarium/solarium 5.1.x see https://www.drupal.org/project/search_api_solr/issues/3085196

[kayakr]

Some note on doing this on a working instance using versions above. I found composer would not simply update search_api and search_api_solr in place, e.g.

composer require drupal/search_api_solr
blocked by installation request for maennchen/zipstream-php (locked at v0.4.1)

I ended up disabling search_api_solr

• pm:uninstall drupal/search_api_solr brings down islandora_search etc.
• removing search_api and search_api_solr and solarium from composer.lock and search_api_solr from filesystem.
  Update components via composer
• composer require drupal/search_api_solr, succeeds
• composer require drupal/search_api, succeeds
• drush updb, search_api update hook 8106, ok
• drush cr
• Reinstate search, drush en --yes islandora_search

Now Solr is reachable as a server, but Search API Solr complains "Solarium 5.0.2 is too old and has known issues. In order to get composer to upgrade solarium to a recent version a core patch or a workaround is required. Have a look at this Core issue and this Search API Solr issue."

Indexes have lost association with Solr Server, and are disabled.

• Re-associate index with Solr Server and enable.
• Reindex content, fail

Update Solarium per https://www.drupal.org/project/search_api_solr/issues/3085196

• composer require symfony/event-dispatcher:"4.3.9 as 3.4.99"

• composer update solarium/solarium updates solarium to 5.1.6 (5.1.4 reported at /admin/reports/status)

• Download fresh Solr config from Search API Solr web UI, and copy into Solr, e.g. /var/solr/data/d8/conf/

• Reindex via web UI

[elizoller]

I put in a PR for this last month here Islandora-Devops/islandora-playbook#157
I'd appreciate another set of eyes if you want