This document discusses incremental building in Greenstone and describes the depositor tool. It explains that the depositor allows uploading documents to a Greenstone collection and provides two options for whether it rebuilds the collection on each upload. It also describes how to perform an incremental rebuild from the command line to index uploaded documents. Key steps include running import.pl and buildcol.pl initially, and then incremental-rebuild.pl for subsequent updates.

1. Incremental building
on Greenstone

2. Diego J. Spano 2011 - Página | 2 |
Import / BuildImport / Build

3. Diego J. Spano 2011 - Página | 3 |
Documents
Import
Metadata extraction
Convertion to GA Format
GA + source docs
Build
Collect.cfg
(plugins)
GS Collection: indexes and
browsing structures…
Collect.cfg
(indexes,
classifiers)
Search Results
Collect.cfg +
macros

4. Diego J. Spano 2011 - Página | 4 |
$GSDLHOME
collect
demo
import archives building index etc perllib
Source documents
import.pl
buildcol.pl
rm –r index/*
mv building/* index
Collection is
served from here
Collect.cfg
The building workflow

5. Diego J. Spano 2011 - Página | 5 |
demo
import archives building index etc perllib
Doc1.pdf
Doc2.pdf
Doc3.doc
Doc4.jpg
HASH0105.di
r
HASH017d.di
r
HASH63e6.di
r
HASHaad6.di
r
(empty)
assoc
dtx
stt
stx
Text
build.cfg
collect
.cfg
The building workflow

6. Diego J. Spano 2011 - Página | 6 |
DepositorDepositor

7. Diego J. Spano 2011 - Página | 7 |
The Depositor
Edit
/greenstone/etc/main.cfg and
add:
depositor enabled

8. Diego J. Spano 2011 - Página | 8 |
The Depositor
You can choose any collection for
upload the document but…
You need a user/password created by
the GS administrator

9. Diego J. Spano 2011 - Página | 9 |
The Depositor
You can choose any collection for
upload the document but…
You need a user/password created by
the GS administrator

10. Diego J. Spano 2011 - Página | 10 |
The Depositor
Now we have access to the Form…

11. Diego J. Spano 2011 - Página | 11 |
The Depositor
We select the file to upload…
And Confirm before uploading the item

12. Diego J. Spano 2011 - Página | 12 |
The Depositor
There are two options for the last step. We
can choose one of them just editing the
macro file “deposit.dm”:
_laststep_ {bild}
or
_laststep_ {depositonly}

13. Diego J. Spano 2011 - Página | 13 |
The Depositor
If we select
_laststep_ {bild}
then Depositor will
build the collection
every time a
document is
uploaded.

14. Diego J. Spano 2011 - Página | 14 |
The Depositor
If we select
_laststep_{depositonly}
then Depositor will only
save the document in
import folder.
We have to build the
collection when we want to
update the index.

15. Diego J. Spano 2011 - Página | 15 |
The Depositor
How can we build the collection to get the
uploaded documents indexed???
We can use GLI
Or
We can use Command Line

16. Diego J. Spano 2011 - Página | 16 |
The Depositor
In GLI CREATE panel  Minimal Rebuild option

17. Diego J. Spano 2011 - Página | 17 |
C:> cd "C:greenstone"
C:greenstone> setup.bat
The first time we will make a full build
C:greenstone> perl -S import.pl coll_name
C:greenstone> perl -S buildcol.pl coll_name
Next time we run only incremental process
C:greenstone> perl -S incremental-rebuild.pl coll_name
The Depositor
Or… open a terminal window and …

18. Diego J. Spano 2011 - Página | 18 |
Depositor will only work with Apache web server. No way with local
library server.
Incremental build needs Lucene as indexer (no MG or MGPP)
Before doing an incremental indexing we have to run a full
import/build process
Incremental build through command line can be scheduled in cron
(Linux) or scheduled task (Windows)
The Depositor
Things to be careful about

19. Diego J. Spano 2011 - Página | 19 |
THANKS !!!
Diego Spano
dspano@prodigioconsultores.com
www.prodigioconsultores.com