migration-tools.git
13 months agochange to the data directly automatically with mig env use master
Jason Etheridge [Fri, 28 Aug 2020 13:25:04 +0000]
change to the data directly automatically with mig env use

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

14 months agothinko fixing the thinko :D one should test before commiting
Jason Etheridge [Tue, 11 Aug 2020 19:36:20 +0000]
thinko fixing the thinko :D one should test before commiting

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

14 months agothinko with branch handling
Jason Etheridge [Tue, 11 Aug 2020 19:34:45 +0000]
thinko with branch handling

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

14 months agofor mig bibstats
Jason Etheridge [Tue, 11 Aug 2020 17:09:36 +0000]
for mig bibstats

--item_type_subfield will make use of --holding_code and provide a breakdown of
bib types by item types.  If --branch_subfield is also provided, then the
breakdown will be further subdivided by branch.

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

14 months agoconvert tabs to spaces for my sanity :)
Jason Etheridge [Tue, 11 Aug 2020 15:39:30 +0000]
convert tabs to spaces for my sanity :)

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

14 months agomake the straight listing of rows for the file optional via --list
Jason Etheridge [Fri, 31 Jul 2020 14:46:31 +0000]
make the straight listing of rows for the file optional via --list

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

14 months agorenamed file since acq was added to it
Rogan Hamby [Thu, 23 Jul 2020 19:15:41 +0000]
renamed file since acq was added to it

14 months agoadd event output removal
Rogan Hamby [Wed, 22 Jul 2020 19:37:28 +0000]
add event output removal

14 months agorename 13 to be more accurate
Rogan Hamby [Wed, 22 Jul 2020 19:16:26 +0000]
rename 13 to be more accurate

14 months agoadding acq stuff into patron extras file
Rogan Hamby [Wed, 22 Jul 2020 19:01:06 +0000]
adding acq stuff into patron extras file

14 months agoremoving copy alerts
Rogan Hamby [Wed, 22 Jul 2020 18:20:36 +0000]
removing copy alerts

14 months agoremove account adjustment entries
Rogan Hamby [Wed, 22 Jul 2020 14:20:59 +0000]
remove account adjustment entries

14 months agoremove inventory data
Rogan Hamby [Tue, 21 Jul 2020 19:58:29 +0000]
remove inventory data

14 months agohandling foreign owned reports of templates to be deleted when they aren't scheduled...
Rogan Hamby [Tue, 21 Jul 2020 19:52:31 +0000]
handling foreign owned reports of templates to be deleted when they aren't scheduled in the future

14 months agoorder of operations improvement on org removal scripts
Rogan Hamby [Tue, 21 Jul 2020 13:52:33 +0000]
order of operations improvement on org removal scripts

14 months agomoving serials before copy templates to resolve an order of operatiosn issue
Rogan Hamby [Tue, 21 Jul 2020 13:42:54 +0000]
moving serials before copy templates to resolve an order of operatiosn issue

14 months agofixing thinko
Rogan Hamby [Tue, 21 Jul 2020 13:28:53 +0000]
fixing thinko

14 months agoadding the create exceeds fines function
Rogan Hamby [Mon, 20 Jul 2020 20:37:56 +0000]
adding the create exceeds fines function

15 months agomake mig-bibstats able to read marcxml or marc21
Rogan Hamby [Tue, 14 Jul 2020 17:32:58 +0000]
make mig-bibstats able to read marcxml or marc21

15 months agoenhancements to mig prepbibs
Rogan Hamby [Tue, 14 Jul 2020 16:56:29 +0000]
enhancements to mig prepbibs

15 months agomoving kmig referene to emig for evergreen version of prepbibs
Rogan Hamby [Tue, 14 Jul 2020 15:33:22 +0000]
moving kmig referene to emig for evergreen version of prepbibs

15 months agomaking the null out columns functions able to handle the term NULL and a single space...
Rogan Hamby [Tue, 14 Jul 2020 13:34:39 +0000]
making the null out columns functions able to handle the term NULL and a single space in case they haven't been trimmed

15 months agoadding emig prepbibs function
Rogan Hamby [Mon, 13 Jul 2020 15:32:49 +0000]
adding emig prepbibs function

15 months agoadding prep bibs to move 999s to 998s
Rogan Hamby [Mon, 13 Jul 2020 15:26:01 +0000]
adding prep bibs to move 999s to 998s

15 months agoadd warning for 999 fields and change name of app to use
Rogan Hamby [Mon, 13 Jul 2020 14:57:38 +0000]
add warning for 999 fields and change name of app to use

15 months agoadd warning for 999 fields
Rogan Hamby [Mon, 13 Jul 2020 14:56:28 +0000]
add warning for 999 fields

15 months agomake a message more meaningful
Rogan Hamby [Mon, 13 Jul 2020 14:48:22 +0000]
make a message more meaningful

15 months agoRevert "moar data"
Jason Etheridge [Tue, 7 Jul 2020 17:46:11 +0000]
Revert "moar data"

This reverts commit 7133775722f9c0c65a40571a3e71a90d2c0a27b2.

15 months agomoar data
Jason Etheridge [Mon, 6 Jul 2020 21:31:41 +0000]
moar data

15 months agohave mig-import remove memcache keys and restart plack
Rogan Hamby [Fri, 26 Jun 2020 16:39:56 +0000]
have mig-import remove memcache keys and restart plack

15 months agominor bugfixs to mig-import
Rogan Hamby [Fri, 26 Jun 2020 16:08:33 +0000]
minor bugfixs to mig-import

15 months agoteach mig-import to bring in message preferences
Rogan Hamby [Thu, 25 Jun 2020 21:38:56 +0000]
teach mig-import to bring in message preferences

15 months agomig-export now does message preferences
Rogan Hamby [Thu, 25 Jun 2020 20:22:58 +0000]
mig-export now does message preferences

15 months agomissed a few lines to cleanup and move ALTER statements to sql_noresult
Rogan Hamby [Thu, 25 Jun 2020 20:04:04 +0000]
missed a few lines to cleanup and move ALTER statements to sql_noresult

15 months agomoving libraries, patroncategories and itemtypes to the front of the restore list...
Rogan Hamby [Thu, 25 Jun 2020 19:55:35 +0000]
moving libraries, patroncategories and itemtypes to the front of the restore list to make sure they are done first

15 months agoteach mig-export to use a sql query function instead of implementing the same lines...
Rogan Hamby [Thu, 25 Jun 2020 19:45:14 +0000]
teach mig-export to use a sql query function instead of implementing the same lines over and over

15 months agoteach mig import to use some funcitons for sql queries to reduce line count and impro...
Rogan Hamby [Thu, 25 Jun 2020 19:24:52 +0000]
teach mig import to use some funcitons for sql queries to reduce line count and improve readability and make a few functions more consistnet in how they check existing data

15 months agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Thu, 25 Jun 2020 18:46:27 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

15 months agomaking restore_itemtypes consistent with using check_itemtype
Rogan Hamby [Thu, 25 Jun 2020 18:46:08 +0000]
making restore_itemtypes consistent with using check_itemtype

15 months agom_upsert_datafield for kmig
Jason Etheridge [Wed, 24 Jun 2020 18:58:01 +0000]
m_upsert_datafield for kmig

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

15 months agologic checking category code and item type on isssues and circ rules as well as error log
Rogan Hamby [Fri, 19 Jun 2020 21:19:02 +0000]
logic checking category code and item type on isssues and circ rules as well as error log

15 months agoadd mysql function to remove non-alphanumeric characters
Rogan Hamby [Wed, 17 Jun 2020 13:09:04 +0000]
add mysql function to remove non-alphanumeric characters

15 months agodon't allow systempreferences to be null
Rogan Hamby [Tue, 16 Jun 2020 19:12:50 +0000]
don't allow systempreferences to be null

15 months agoadding letter syncing to kmig import and export
Rogan Hamby [Tue, 16 Jun 2020 18:30:05 +0000]
adding letter syncing to kmig import and export

16 months agom_insert_tag for kmig
Jason Etheridge [Mon, 15 Jun 2020 15:53:00 +0000]
m_insert_tag for kmig

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

16 months agofixing typo that caused a false value assignment
Rogan Hamby [Fri, 12 Jun 2020 17:10:53 +0000]
fixing typo that caused a false value assignment

16 months agoa quality of life function to make it easier to modify the fixed fields in a biblio...
Rogan Hamby [Thu, 11 Jun 2020 15:35:09 +0000]
a quality of life function to make it easier to modify the fixed fields in a biblio.record_entry record

16 months agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Wed, 10 Jun 2020 17:42:04 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

16 months agoadding better category support to authorised values import/export in kmig
Rogan Hamby [Wed, 10 Jun 2020 17:41:47 +0000]
adding better category support to authorised values import/export in kmig

16 months agokoha function for updating the 003 tag
Jason Etheridge [Tue, 9 Jun 2020 19:35:29 +0000]
koha function for updating the 003 tag

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

16 months agofixed help error in mig-stagebibs for emig
Rogan Hamby [Mon, 8 Jun 2020 16:42:25 +0000]
fixed help error in mig-stagebibs for emig

16 months agofixing on mung_sf9 where it declares int instead of bigint for bib ids
Rogan Hamby [Mon, 8 Jun 2020 16:19:10 +0000]
fixing on mung_sf9 where it declares int instead of bigint for bib ids

16 months agoadding a strip subfield function
Rogan Hamby [Mon, 8 Jun 2020 16:17:59 +0000]
adding a strip subfield function

16 months agomig-import missed a clause for deleting from the itemtypes table
Rogan Hamby [Wed, 3 Jun 2020 15:39:14 +0000]
mig-import missed a clause for deleting from the itemtypes table

16 months agofixed xpath issues with restore_itemtypes
Rogan Hamby [Wed, 3 Jun 2020 15:10:41 +0000]
fixed xpath issues with restore_itemtypes

16 months agoadded to kmig bookseller and budget support to import and export
Rogan Hamby [Tue, 2 Jun 2020 20:15:34 +0000]
added to kmig bookseller and budget support to import and export

16 months agoadding the start of base sql and marc functions for koha to mig-init
Rogan Hamby [Tue, 2 Jun 2020 13:49:23 +0000]
adding the start of base sql and marc functions for koha to mig-init

16 months agoadding the start of base sql and marc functions for koha to mig-init
Rogan Hamby [Tue, 2 Jun 2020 13:49:08 +0000]
adding the start of base sql and marc functions for koha to mig-init

16 months agobase staging tables for koha added for kmig.d/init
Rogan Hamby [Tue, 2 Jun 2020 13:42:49 +0000]
base staging tables for koha added for kmig.d/init

16 months agoreplace borrower_attributes with borrowerattributes for file name in mig-export
Rogan Hamby [Thu, 28 May 2020 17:46:35 +0000]
replace borrower_attributes with borrowerattributes for file name in mig-export

16 months agoadding borrower attributes to mig import/export
Rogan Hamby [Wed, 27 May 2020 20:33:51 +0000]
adding borrower attributes to mig import/export

16 months agoadding m_ for koha functions and an update_leader function
Rogan Hamby [Wed, 27 May 2020 15:52:37 +0000]
adding m_ for koha functions and an update_leader function

16 months agokmig import/export now support syncing reports
Rogan Hamby [Thu, 21 May 2020 20:58:28 +0000]
kmig import/export now support syncing reports

16 months agovarious enhacnements to emig bibstats including adding it to kmig
Rogan Hamby [Tue, 19 May 2020 20:16:03 +0000]
various enhacnements to emig bibstats including adding it to kmig

16 months agoadded profile for Destiny to mig bibstats
Rogan Hamby [Tue, 19 May 2020 17:21:33 +0000]
added profile for Destiny to mig bibstats

17 months agoadjust -test components of kohacatalog.com domains in kmig import
Rogan Hamby [Thu, 7 May 2020 14:41:01 +0000]
adjust -test components of kohacatalog.com domains in kmig import

17 months agoadd some new koha reports
Rogan Hamby [Tue, 5 May 2020 19:17:01 +0000]
add some new koha reports

17 months agochange default behavior for no --analyst tag
Rogan Hamby [Mon, 4 May 2020 19:33:36 +0000]
change default behavior for no --analyst tag

17 months agoset ->do('SET NAMES utf8mb4'); by default
Rogan Hamby [Mon, 4 May 2020 15:50:38 +0000]
set ->do('SET NAMES utf8mb4'); by default

17 months agomore robust versions of kmig import and export
Rogan Hamby [Mon, 4 May 2020 15:49:40 +0000]
more robust versions of kmig import and export

17 months agosimplify a few exports and add one for itemtypes
Rogan Hamby [Wed, 22 Apr 2020 19:10:20 +0000]
simplify a few exports and add one for itemtypes

17 months agoupdated mig export to use xml and mig import supports libraries and preferences
Rogan Hamby [Wed, 22 Apr 2020 17:57:34 +0000]
updated mig export to use xml and mig import supports libraries and preferences

17 months agoupdated mig export to use xml and mig import supports libraries and preferences
Rogan Hamby [Wed, 22 Apr 2020 17:57:22 +0000]
updated mig export to use xml and mig import supports libraries and preferences

17 months agoinitial version of mig-export added for kmig
Rogan Hamby [Fri, 17 Apr 2020 16:22:50 +0000]
initial version of mig-export added for kmig

17 months agounneeded variable declaration removed
Rogan Hamby [Thu, 16 Apr 2020 18:54:00 +0000]
unneeded variable declaration removed

17 months agoremoving no longer needed parameter
Rogan Hamby [Thu, 16 Apr 2020 18:51:43 +0000]
removing no longer needed parameter

17 months agodon't index x_count if we see it
Jason Etheridge [Thu, 16 Apr 2020 14:38:14 +0000]
don't index x_count if we see it

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

17 months agodefault charset and collate for csv2mysql
Jason Etheridge [Thu, 16 Apr 2020 14:36:45 +0000]
default charset and collate for csv2mysql

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

18 months agofirst cut of kmig-quick
Jason Etheridge [Thu, 16 Apr 2020 13:48:16 +0000]
first cut of kmig-quick

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

18 months agoseed kmig-quick with emig-quick
Jason Etheridge [Thu, 16 Apr 2020 13:47:29 +0000]
seed kmig-quick with emig-quick

18 months agoif we come across these, make them BIGINT. mysql/mariadb can't index TEXT
Jason Etheridge [Wed, 15 Apr 2020 20:32:46 +0000]
if we come across these, make them BIGINT. mysql/mariadb can't index TEXT

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

18 months agomake sure worksheet names do not go over 31 characters
Jason Etheridge [Wed, 15 Apr 2020 20:31:11 +0000]
make sure worksheet names do not go over 31 characters

18 months agosimplifying defaults a bit
Rogan Hamby [Wed, 15 Apr 2020 18:11:06 +0000]
simplifying defaults a bit

18 months agoadding kmig reporter
Rogan Hamby [Wed, 15 Apr 2020 18:09:17 +0000]
adding kmig reporter

18 months agowe don't need to pre-create Koha staging tables since mig link and mig stage can... kmig
Jason Etheridge [Fri, 10 Apr 2020 21:00:42 +0000]
we don't need to pre-create Koha staging tables since mig link and mig stage can do it

18 months agofirst cut of kmig-stage, and tweak kmig-link to allow linking to non-existent parent...
Jason Etheridge [Fri, 10 Apr 2020 21:00:12 +0000]
first cut of kmig-stage, and tweak kmig-link to allow linking to non-existent parent tables, since based on the naming convention we can vivicate them

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

18 months agoseed kmig-stage with emig-stage
Jason Etheridge [Fri, 10 Apr 2020 20:48:24 +0000]
seed kmig-stage with emig-stage

18 months agofirst cut of csv2mysql, mig-convert, and a needed tweak for mig-sql
Jason Etheridge [Fri, 10 Apr 2020 20:47:09 +0000]
first cut of csv2mysql, mig-convert, and a needed tweak for mig-sql

18 months agomove csv2mysql into the kmig hierarchy so we can better leverage KMig.pm
Jason Etheridge [Fri, 10 Apr 2020 20:03:57 +0000]
move csv2mysql into the kmig hierarchy so we can better leverage KMig.pm

18 months agoseed csv2mysql with csv2sql
Jason Etheridge [Fri, 10 Apr 2020 20:01:53 +0000]
seed csv2mysql with csv2sql

18 months agoseed kmig-convert with emig-convert
Jason Etheridge [Fri, 10 Apr 2020 19:53:43 +0000]
seed kmig-convert with emig-convert

18 months agofirst cut of kmig-unlink
Jason Etheridge [Fri, 10 Apr 2020 19:31:31 +0000]
first cut of kmig-unlink

18 months agoseed kmig-unlink with emig-unlink
Jason Etheridge [Fri, 10 Apr 2020 19:29:44 +0000]
seed kmig-unlink with emig-unlink

18 months agofirst cut of kmig-link
Jason Etheridge [Fri, 10 Apr 2020 19:29:18 +0000]
first cut of kmig-link

18 months agoseed kmig-link with emig-link
Jason Etheridge [Fri, 10 Apr 2020 19:21:48 +0000]
seed kmig-link with emig-link

18 months agomore path touchups
Jason Etheridge [Fri, 10 Apr 2020 19:20:37 +0000]
more path touchups

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

18 months agomig wrapper to kmig/emig
Jason Etheridge [Fri, 10 Apr 2020 18:44:58 +0000]
mig wrapper to kmig/emig

It won't handle first time setup; you'll need to call emig or kmig explicitly
until an environment is loaded.

Example:

    kmig env create demo
    kmig env use demo
    mig init
    mig add foo.txt etc

Also, the older ~/.mig environment directory, if used with the new mig, will
need to be moved or merged into ~/.emig, and the various *.env files ammended
with:

    export MIGCMD=emig

18 months agorewire to match the new naming scheme and layout
Jason Etheridge [Fri, 10 Apr 2020 18:28:17 +0000]
rewire to match the new naming scheme and layout

18 months agolet's not name these differently than the emig.d/ counterparts
Jason Etheridge [Fri, 10 Apr 2020 18:13:08 +0000]
let's not name these differently than the emig.d/ counterparts

18 months agotoward renaming mig to emig and tweaking the directory layout
Jason Etheridge [Fri, 10 Apr 2020 18:05:56 +0000]
toward renaming mig to emig and tweaking the directory layout