Skip to content

Commit 330de28

Browse files
authored
Update I7solrImporter.md (#140)
* Update I7solrImporter.md Document has been updated through Step 7. All screenshots updated using local version 1.0.0 * Images updated w/ path * I7 Solr Importer Images Update Updated images w/ path * Fixed Image path * Image path fix x2! * Updated to include Next Steps for AMI Set Processing w/ links * Update I7solrImporter.md * Update I7solrImporter.md
1 parent d02f609 commit 330de28

10 files changed

+32
-69
lines changed

docs/I7solrImporter.md

+32-69
Original file line numberDiff line numberDiff line change
@@ -13,8 +13,8 @@ From either the main Content page or the AMI Sets List page, select the 'Start a
1313

1414
Select the Islandora 7 Solr Importer from the dropdown menu.
1515

16-
![Islandora Solr Importer Step 11](images/ami/I7step1.jpg)
17-
16+
![Islandora 7 Solr Importer Step 1 Plugin ](images/I7step1_plugin_updated_2022-11.jpg)
17+
1818
## Step 2, section 1: Solr Server Configuration
1919

2020
You will only have the option to select 'Create New ADOs' as the Operation you would like to perform.
@@ -38,22 +38,35 @@ For larger collections, you may wish to create multiple/split AMI ingest sets by
3838

3939
- As an example, for a collection of 1500 objects that you wanted to split into three AMI ingests of 500 objects, you would specify the Starting Row as 0 for the first set and Number of Rows as 500. For the second set, your Starting Row would be Row 501; for the third set, 1001). In this example, the Number of Rows would always be 500.
4040

41-
![Islandora Solr Importer Step 2 Section 1](images/ami/I7step2_section1.jpg)
41+
![Islandora 7 Solr Importer Step 2 Server Configuration](images/I7step2_serverconfig_updated_2022-11.jpg)
4242

4343
## Step 2, section 2: Islandora Mappings
4444

45-
In this step you will need to make determinations on how you would like to map your Islandora 7 digital objects to your Archipelago repository.
45+
In this step you will need to make determinations on how you would like to map your Islandora 7 digital objects to your Archipelago repository and whether or not you would like to fetch additional file datastreams, such as those for thumbnail images, transcripts, OCRs/HOCRs, etc.
4646

47-
- Selecting "Collapse Multi Children Objects" will collapse Children Datastreams into a single ADO with many attached files (single row in the generated AMI set .csv file). Book Pages will be fetched but also the Top Level PDF (if one exists in your Islandora instance).
48-
![Islandora Solr Importer Step 2 Section 2 Collapse](images/ami/I7step2_section2_collapse.jpg)
47+
- *Selecting "Collapse Multi Children Objects" will collapse Children Datastreams into a single ADO with many attached files (single row in the generated AMI set .csv file). Book Pages will be fetched but also the Top Level PDF (if one exists in your Islandora instance).*
48+
4949

5050
- In the Required ADO mappings, you will need to specify which Archipelago type you want to map each Islandora Content Model found in your source collection.
5151
- For example, for _info:fedora/islandora:sp_large_image_cmodel_ you may want to use _Photograph_.
5252

5353
- If you had left "Collapse Multi Children Objects" unselected, you will also need to specify the Islandora Content Model to ADO types mapping for possible Children.
54-
![Islandora Solr Importer Step 2 Section 2 No Collapse](images/ami/I7step2_section2_nocollapse.jpg)
5554

55+
![Islandora 7 Solr Importer Step 2 Mappings No Collapse](images/I7step2_sect2_nocollapse_updated_2022-11.jpg)
5656
- You can also specify an ADO (Object or Collection) to be used the Parent of Imported Objects. By selecting an existing ADO (Object or Collection) here using the autocomplete/search, the generated AMI set .csv file will contain an 'ismemberof' column containing the UUID of the selected ADO for every row.
57+
- Under "_Additional Datastreams to Fetch_", you can select any number and/or combination of extra file datastreams to retrieve from your harvest. Please not that the I7 Importer will fetch every possible datastream that is present in your source I7 repository, but the additional file datastreams referenced may not be associated with actual files for every digital object.
58+
59+
![Islandora 7 Solr Importer Islandora Mappings](images/I7step2_sect2_IslandoraMappings_updated_2022-11.jpg)
60+
61+
*Language from form itself:*
62+
63+
*Additional datastreams to fetch. OBJ datastream will always be fetched. Not all datastreams listed here might be present once your data is fetched.*
64+
65+
- Selection of any additonal datastreams will generate a dropdown menu under "_Where extra datastreams should go_." Here you will decide the organization and location of those datastreams by selecting one of the two options
66+
- Organize by mime type e.g TRANSCRIPT will go into the "texts" column
67+
- Each in a separate column based on the datastream neame, TRANSCRIPT will go into the "transcripts" column
68+
69+
![Islandora Solr Importer Datastream Placement](images/I7step2_sect2_DSplacement_updated_2022-11.jpg)
5770

5871
## Step 3: Data Transformation Selections
5972

@@ -68,15 +81,15 @@ Select the data transformation approach--how your source data will be transforme
6881
3. Template
6982
- Columns from your spreadsheet source will be cast to ADO metadata (JSON) using a Twig template setup for JSON output.
7083

71-
- You will also need to Select which columns contain filenames, entities or URLS where files can be fetched from. Select what columns correspond to the Digital Object types found in your spreadsheet source.
84+
- You will also need to Select which columns contain filenames, entities or URLS where files can be fetched from. Select what columns correspond to the Digital Object types found in your spreadsheet source. If you fetched additional file datastreams during Step 2, you will see those columns listed here as well (see screenshot below for examples).
7285

7386
- Lastly, for this step, you will need to select the destination Fields and Bundles for your New ADOs. If your spreadsheet source only contains Digital Objects, select `Strawberry (Descriptive Metadata source) for Digital Object`
7487

7588
- If using Sheet 1 of the Demo AMI Ingest set (found above):
7689
- Select `Template` and use the AMI Ingest JSON template that corresponds with your metadata elements.
7790
- Select `images`, `documents`, and `audios` for the file source/fetching.
7891

79-
![AMI Step 3 Data Transformation Mappings](images/ami/AMIstep3JSONtemplateDataTransformation.jpg)
92+
![Islandora Solr Importer Data Transformation](images/I7step3_DataTransformation_updated_2022-11.jpg)
8093

8194
## Step 4: Global ADO Mappings
8295

@@ -91,79 +104,29 @@ Select your global ADO mappings.
91104
- Do not select any column for 'Sequence'
92105
- Select the `label` column for ADO Label
93106

94-
![AMI Step 4 Global ADO Mappings](images/ami/AMIstep4GlobalADOmappings.jpg)
107+
![Islandora Solr Importer Global ADO Mappings](images/I7step4_GlobalADOMap_updated_2022-11.jpg)
95108

96-
## Step 5: ZIP upload
109+
## Step 5: ZIP upload and AMI Set naming
97110

98111
For standard Spreadsheet or Google Sheets AMI ingests, you would use this step to provide an optional ZIP file containing your assets.
99112

100-
For your Islandora 7 Solr Importer process, the generated AMI set .csv file will contain the necessary URLs to the corresponding Islandora 7 file datastreams for each object as needed. Select next to skip this ZIP upload step and proceed.
113+
For your Islandora 7 Solr Importer process, the generated AMI set.csv file will contain the necessary URLs to the corresponding Islandora 7 file datastreams for each object as needed. Select next to skip this ZIP upload step and proceed.
101114

102-
![AMI Step 5 Zip](images/ami/AMIstep5zip.jpg)
103-
104-
## Step 6: Batch fetching from Solr
105-
106-
During this step, AMI will fetch the specified digital objects from the remote Solr source. This is generally a quick process, but be aware that settings in the remote Solr source can impact the response time.
107-
108-
![Islandora Solr Importer Step Batch Solr Fetching](images/ami/AMIstep4GlobalADOmappings.jpg)
115+
After you provide a title for your AMI set under "_Please Name your AMI set_", select "_Press to Create Set_"
109116

110-
## Step 7: AMI Set Confirmation
117+
![Islandora 7 Solr Importer Zip upload and AMI Set naming](images/I7step5_Zip_AMI_Naming_updated_2022-11.jpg)
118+
119+
## Step 6: AMI Set Confirmation
111120

112121
You will now see a message letting your know your "New AMI Set was created". You will be able to review the generated .csv file directly from this page under Source Data File.
113122

114-
![Islandora Solr Importer Step 7 Set Creation](images/ami/I7step7_setCreated.jpg)
123+
![Islandora 7 Solr Importer AMI Set Confirmation](images/I7step7_Set_Creation_updated_2022-11.jpg)
115124

116125
While you may immediately select "Process" from this AMI Set Confirmation page to use the Islandora 7 Importer generated .csv file as-is to ingest the ADOs in your AMI set, it is strongly recommended that you review the .csv file first. AMI is configured to trim unecessary (for Archipelago) and de-duplicate redundant Solr source data, but you may wish to pare down the sourced data even further and/or conduct general metadata review and cleanup before migrating your content. You will also likely want to make adjustments to your AMI Ingest JSON Template based on your review, depending on the variation of metadata columns/keys found in your source repostiory.
117126

118-
## Step 8: AMI Set Processing
119-
120-
Whether you have chosen to review your .csv file or not, your newly created AMI Set will now need to be Processed.
121-
122-
On the main AMI set page, you can review the configurations and Source Data File for your set (determined by your selections in the preceding steps).
123-
124-
![AMI Set Admin Review](images/ami/AMIsetAdminReview.jpg)
125-
126-
To Process this set, navigate to the `Process` tab. You will have two options related to the Processing outcome for your AMI Set.
127-
128-
- Option 1: Select the "Desired ADOS Statuses After Process" for both Digital Objects (and Digital Object Collections, if also part of your ingest).
129-
- The Statuses you have available will reflect the publication workflow/moderation states (such as Draft, Published, Archived/Unpublished) setup in your Archipelago instance, and the permissions associated your user account.
130-
- Option 2: You may choose to check the option to 'Enqueue but do not process Batch' to place the AMI set in the Queue to Process. *For the AMI version shipped with Archipelago 1.0.0-RC2, the option to 'Enqueue' for scheduled/future Processing should only be used if the Queue operations for your Archipelago instance are configured. Please return to this page for updated Enqueueing instructions that will accompany future releases.*
131-
- Select `Confirm` to continue.
132-
133-
![AMI Admin Set Process](images/ami/AMIsetAdminProcessRC2.jpg)
134-
135-
You may also select `Process` from the `Operations` menu for the AMI set from the main `AMI sets` page.
136-
137-
![AMI Sets Admin Process Operations Menu](images/ami/AMISetAdminProcessOpsMenu.jpg)
138-
139-
If you chose to 'Confirm" and Process your AMI Set immediately, proceed to Step 9: Processing and ADO Creation.
140-
141-
## Step 9: Queue Manager (if not Processing immediately)
142-
143-
If you chose to place your AMI set in the Queue to Process in step 7, you may need to navigate to the Queue Manager found at `/admin/config/system/queue-ui`. (Be sure to select the `Queue Manager` under the System section, not the `Queue Manager for Hydroponic Service` under the Archipelago section). If the Queue operations for your Archipelago instance have been configured, you can simply leave your AMI Set in the Queue for Processing on the preconfigured schedule.
144-
145-
![AMI Queue Manager](images/ami/AMIqueueMgr.jpg)
146-
147-
To Process your AMI Set immediately from the Queue Manager page, select the checkbox next to the 'AMI Digital Object Ingester Queue Worker'. Keep the `Action` menu set to `Batch Process` and click the `Apply to selected items` button.
148-
149-
![AMI Queue Manager Batch](images/ami/AMIqueueMgrBatchProcess.jpg)
127+
## Next Steps
150128

151-
## Step 10: Processing and ADO Creation
152-
153-
Your AMI set will now be Processed. You can follow the set's progress through the `Processing queues` loading screen.
154-
155-
![AMI Processing Queues](images/ami/AMIprocessingQueue.jpg)
156-
157-
After your AMI set is Processed, you will receive confirmation messages letting you know your Digital Objects were successfully created.
158-
159-
![AMI Set Succes](images/ami/AMIsetSuccessRC2.jpg)
160-
161-
From this message, you can click on each ADO title to review the new created Digital Object (or Collection) if you wish. Or, you may proceed to step 10.
162-
163-
## Step 11: Review your newly created Digital Objects
164-
165-
Return to the main Content page found at `/admin/content` and review your newly created Digital Objects. After ensuring that files and metadata elements were mapped correctly, you may choose to change the Status for your Digital Objects to 'Published'. Celebrate your AMI success with a fresh coffee, tea, or cookie!
166-
129+
To proceed with Processing your AMI Set, [click here](AMIviaSpreadsheets.md#step-7-ami-set-processing) to directed to the main [Ingesting Digital Objects via Spreadsheets](AMIviaSpreadsheets.md).
167130
___
168131

169132
Thank you for reading! Please contact us on our [Archipelago Commons Google Group](https://groups.google.com/forum/#!forum/archipelago-commons) with any questions or feedback.
5.47 KB
Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading
Loading

0 commit comments

Comments
 (0)