Johns Hopkins Blacklight Implementation

Upgrade Solr to 1.4.1

Details

  • Type: Task Task
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Fixed
  • Affects Version/s: Milestone 3
  • Fix Version/s: Milestone 3
  • Component/s: None
  • Description:
    Hide
    We're still using a weird Solr pre-1.4 nightly that used to be distributed with Blacklight. BL was recently upgraded to 1.4.1.

    We should upgrade our own solr (in jetty/tomcat) to 1.4.1.

    1. Upgrade solr.war [test]

    2. Upgrade all pertinent files in solr/lib to 1.4.1 versions. [test]

    3. Upgrade schema.xml to include 1.4.1 comments/examples/new fields available, and take advantage of 1.4.1 new features where neccesary (use new trie-based int for pub_date_sort). [test]

    4. Upgrade BL distro example/test schema.xml to do same, and provide better example and instructions for those getting started.

    Also, once this has been done, we can turn spellcheck back on too, by editing the solrconfig.xml for "search" request handler to make "spellcheck" "on" a default parameter again.
    Show
    We're still using a weird Solr pre-1.4 nightly that used to be distributed with Blacklight. BL was recently upgraded to 1.4.1. We should upgrade our own solr (in jetty/tomcat) to 1.4.1. 1. Upgrade solr.war [test] 2. Upgrade all pertinent files in solr/lib to 1.4.1 versions. [test] 3. Upgrade schema.xml to include 1.4.1 comments/examples/new fields available, and take advantage of 1.4.1 new features where neccesary (use new trie-based int for pub_date_sort). [test] 4. Upgrade BL distro example/test schema.xml to do same, and provide better example and instructions for those getting started. Also, once this has been done, we can turn spellcheck back on too, by editing the solrconfig.xml for "search" request handler to make "spellcheck" "on" a default parameter again.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Jonathan Rochkind added a comment - 30/Aug/10 10:19 AM
1. Moved war file from solr source, in dist/apache-solr-1.4.1.war to /usr/share/tomcat6/webapps/solr.war

Restarted tomcat. Seems to be working fine.
Show
Jonathan Rochkind added a comment - 30/Aug/10 10:19 AM 1. Moved war file from solr source, in dist/apache-solr-1.4.1.war to /usr/share/tomcat6/webapps/solr.war Restarted tomcat. Seems to be working fine.
Hide
Permalink
Jonathan Rochkind added a comment - 30/Aug/10 11:32 AM
2. There were a buncha files in solr_home/lib that were about solr "cell", the content extraction plugin. We don't use this. Rather than try to figure out how to upgrade it, I just removed those files.

What remains is:
* apache-solr-umichnormalizers.jar
* normalizer.jar
* UnicodeNormalizeFilter.jar

I'm not sure why we need three jars for this, but trying to remove any seemed to disturb functionality, so just leaving this there for now. Also, the "apache-solr-umich" one, I think, is from Bob@umich, NOT from the solr project, so probably shouldn't begin with "apache-solr-", but leaving it alone for now. Not entirely sure what the others are, but removing any of them seems to cause problems.
Show
Jonathan Rochkind added a comment - 30/Aug/10 11:32 AM 2. There were a buncha files in solr_home/lib that were about solr "cell", the content extraction plugin. We don't use this. Rather than try to figure out how to upgrade it, I just removed those files. What remains is: * apache-solr-umichnormalizers.jar * normalizer.jar * UnicodeNormalizeFilter.jar I'm not sure why we need three jars for this, but trying to remove any seemed to disturb functionality, so just leaving this there for now. Also, the "apache-solr-umich" one, I think, is from Bob@umich, NOT from the solr project, so probably shouldn't begin with "apache-solr-", but leaving it alone for now. Not entirely sure what the others are, but removing any of them seems to cause problems.
Hide
Permalink
Jonathan Rochkind added a comment - 30/Aug/10 12:24 PM
Updated schema.xml to be based on 1.4.1 schema, with comments.

Changed pub_date_sort to use new 'tint' field for fast range filtering.

Changed dynamic numeric fields to use new numeric solr types that are sortable.

Will require a re-index with new schema, so won't deploy to production till end of day.
Show
Jonathan Rochkind added a comment - 30/Aug/10 12:24 PM Updated schema.xml to be based on 1.4.1 schema, with comments. Changed pub_date_sort to use new 'tint' field for fast range filtering. Changed dynamic numeric fields to use new numeric solr types that are sortable. Will require a re-index with new schema, so won't deploy to production till end of day.
Hide
Permalink
Jonathan Rochkind added a comment - 30/Aug/10 12:54 PM
Updated solrconfig.xml to have comments and changed suggested defaults from distro solr 1.4.1 version.

Deployed to production.

This schema change required a complete re-index, so deleted index, and am re-indexing now.
Show
Jonathan Rochkind added a comment - 30/Aug/10 12:54 PM Updated solrconfig.xml to have comments and changed suggested defaults from distro solr 1.4.1 version. Deployed to production. This schema change required a complete re-index, so deleted index, and am re-indexing now.
Hide
Permalink
Jonathan Rochkind added a comment - 31/Aug/10 2:41 PM
Done. Analagous changes made in core BL example/test solr setup, and committed back to BL project.
Show
Jonathan Rochkind added a comment - 31/Aug/10 2:41 PM Done. Analagous changes made in core BL example/test solr setup, and committed back to BL project.

People

Dates

  • Created:
    05/Aug/10 8:41 AM
    Updated:
    31/Aug/10 2:41 PM
    Resolved:
    31/Aug/10 2:41 PM
Atlassian JIRA (v4.1.2#531) | Report a problem | Request a feature | Contact administrators
Powered by a free Atlassian JIRA open source license for Blacklight. Try JIRA - bug tracking software for your team.