v.2 testing

Introduction

Testing of v.2 includes ingest and clustering in the staging environment.

Ingest tests

Counts

Testing of ingest includes count comparisons between suppressed instances stored in the host LMS and instances for the host LMS stored in the DCB. The three FOLIO instances include:

• Truman University (Production)

• University of Missouri (Test)

• Calvary University (Staging)

This is the folder with the record comparisons for all three FOLIO tenants but start with the DCB v.2 testing – staging doc for context and the SQL used to generate the counts.

CRUD

Testing of ingest also included whether or not creation, update and deletion actions and, suppression and unsuppression actions in FOLIO resulted in the expected behavior in DCB. You can find the results here.

Analysis of counts

For Truman University instances that were not found in DCB and vice versa and concluded the following observations:

• Suppressed FOLIO instances are making their way into the union catalog. Examples:

• For Truman University, the reports show that there are +1.089% records in DCB than FOLIO. That said, of the 11 records checked, all were located in Truman’s FOLIO using the Inventory application. It’s unclear why the SQL results in these are being reported in DCB but not in FOLIO.

• I suspect the query resulting in more records in DCB than FOLIO is wrong. FOLIO’s inventory app reports 635,589 unsuppressed instances v. 630,731 via the FOLIO query v. 637,600 via the DCB query.

University of Missouri there are +4.38% reported in DCB that are not reported in FOLIO. I reviewed 10 records and here is what I found:

• Again, the numbers are not making sense. The Inventory application reports 4,585,040 unsuppressed instances. The query results in 4,584,880 unsuppressed instances, a difference of 160 instances. DCB query results in 4,785,864. If we assume that the suppressed FOLIO instances are being added to DCB and then subtract the 260,429 suppressed FOLIO instances we get 4,525,435 which leaves about 60,000 instances short.

For Calvary University the discrepancy is significantly smaller (+0.09%). I reviewed 7 records, all of which are in FOLIO and all of which are suppressed.

• The FOLIO query results in 29,434 unsuppressed instances. The Inventory app reports 29,423 unsuppressed instances and 35 suppressed instances. The DCB query 29,461 instances. Subtracting the reported 35 FOLIO suppressed instances gives a total of 29,426, very very close to what the inventory app reports as unsuppressed instances.

Carole Godfrey shared an OAI document that may be helpful in providing insight into the discrepancies. The documentation did not reveal any insights for me but it would be good to have a second pair of eyes take a gander.

Cluster tests

This Jira filter is a temporary substitute for a list of clustering use cases. These are the reports from customers in production. Next step is to find the corresponding records in staging and then report the results. It’s expected that not all reported problems will be found in staging since not all reports include libraries that are part of the staging environment.

Cluster instance records