Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

SLOW INGEST PERFORMANCE ON INSTANCE

Info

https://jira.kuali.org/browse/OLE-2863

Currently the develop team work on investigating the following thing:

  1. Apache Camel: if OLE DocStore uses Camel in the right way
    1. multi-threading in Camel code -- facing concurrency issues while updating docstore nodes, now the feature is turned off during bulk ingest.
  2. Feed docs to Solr: If there is a more efficient way to feed the incoming records to Solr for indexing
    1. Pranitha has observed that converting from pojo to SolrInputDocuments is taking very less time when compared to converting xml into pojos.
      Solr commit operation has two flags "waitFlush" and "waitSearcher". Turning these flags off can make commit faster.
      Pranitha is looking into it.
  3. Where to keep the linkages

...