Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Ingest GIL FOLIO tenants to K-Int Development environment

Description

Goal

Verify and baseline GIL ingest from FOLIO ECS to K-Int (GIL) Dev environment

In Scope

  • Configure environment to use ingest v2 (K-Int)

  • Prepare FOLIO tenants for harvest (FSE)

  • Harvest all tenant catalogues (K-Int)

    • Cohort 1: UGA, Kennesaw and Middle Georgia (12 Nov Wed 6 Nov)

    • Cohort 2: Georgia State Uni, Georgia Southern, Georgia Institute of Technology, Augusta (13 Nov Thu 7 Nov)

    • Cohort 3: the remaining 21 libraries (14 Nov Fri 8 Nov)

  • Baseline volume and ingest metrics per tenant and for all tenant libraries

  • Baseline clustering metrics for consortium (number of clustered records and performance)

  • Verify bib suppression is honoured per FOLIO contribution criteria: suppressedFromDiscovery = true

Out of scope

  • Configure and apply per-library bib suppression rules

  • Georgia Institute of Technology - this will be ingested via Alma

Nov 8, 2024 Target dates pushed back to accommodate timeout investigation.

Attachments

1
  • 12 Nov 2024, 12:21 PM
100% Done
Loading...

Activity

Show:

Jag Goraya November 19, 2024 at 8:37 PM

What else is the expectation from this ticket or can we mark this done? Thanks!

: Please see description for ticket scope. The ingest prep is only part of this activity, so it can’t mark as done yet.

Sobha Duvvuri November 19, 2024 at 3:53 PM

: Update: The underlying problem that was giving 504s earlier is fixed now. The pending step of preparing the environments in cohorts is being addressed in scope of https://openlibraryfoundation.atlassian.net/browse/DCB-1713, https://openlibraryfoundation.atlassian.net/browse/DCB-1714 and https://openlibraryfoundation.atlassian.net/browse/DCB-1715. What else is the expectation from this ticket or can we mark this done? Thanks!

Sobha Duvvuri November 17, 2024 at 1:48 PM

ok, done. Let’s target to have all cohorts be prepped for ingestion by November 21st.

Jag Goraya November 14, 2024 at 4:35 PM

Please see comment re Cohort 3 sequencing - please reply in that ticket to confirm.

TL/DR:

  1. Complete Cohort 1 and 2 prep as planned

  2. Extend Cohort 3 timeline rather than batch smaller.

Jag Goraya November 14, 2024 at 9:51 AM

Thanks for the update and context. I’ll revise the Cohort 3 breakdown in line with the constraints and post here when done.

In the meantime. I understand from's update that fixes for Cohorts 1 and 2 are underway. Please update https://openlibraryfoundation.atlassian.net/browse/DCB-1713 and https://openlibraryfoundation.atlassian.net/browse/DCB-1714 to indicate when they are done. I have moved them to In Progress but if they are not yet, please reset them to Open. More details in comments on those specific subtasks.

Done

Details

Assignee

Reporter

Labels

Components

Parent

Environment

K-Int Development (GIL)

Target Version

Sprint

Start Date

Due date

Priority

Created October 30, 2024 at 11:09 AM
Updated January 10, 2025 at 1:47 PM
Resolved January 10, 2025 at 1:47 PM