migration-tools.git
2 years agothinko fixing the thinko :D one should test before commiting
Jason Etheridge [Tue, 11 Aug 2020 19:36:20 +0000]
thinko fixing the thinko :D one should test before commiting

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agothinko with branch handling
Jason Etheridge [Tue, 11 Aug 2020 19:34:45 +0000]
thinko with branch handling

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agofor mig bibstats
Jason Etheridge [Tue, 11 Aug 2020 17:09:36 +0000]
for mig bibstats

--item_type_subfield will make use of --holding_code and provide a breakdown of
bib types by item types.  If --branch_subfield is also provided, then the
breakdown will be further subdivided by branch.

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agoconvert tabs to spaces for my sanity :)
Jason Etheridge [Tue, 11 Aug 2020 15:39:30 +0000]
convert tabs to spaces for my sanity :)

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agomake the straight listing of rows for the file optional via --list
Jason Etheridge [Fri, 31 Jul 2020 14:46:31 +0000]
make the straight listing of rows for the file optional via --list

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agorenamed file since acq was added to it
Rogan Hamby [Thu, 23 Jul 2020 19:15:41 +0000]
renamed file since acq was added to it

2 years agoadd event output removal
Rogan Hamby [Wed, 22 Jul 2020 19:37:28 +0000]
add event output removal

2 years agorename 13 to be more accurate
Rogan Hamby [Wed, 22 Jul 2020 19:16:26 +0000]
rename 13 to be more accurate

2 years agoadding acq stuff into patron extras file
Rogan Hamby [Wed, 22 Jul 2020 19:01:06 +0000]
adding acq stuff into patron extras file

2 years agoremoving copy alerts
Rogan Hamby [Wed, 22 Jul 2020 18:20:36 +0000]
removing copy alerts

2 years agoremove account adjustment entries
Rogan Hamby [Wed, 22 Jul 2020 14:20:59 +0000]
remove account adjustment entries

2 years agoremove inventory data
Rogan Hamby [Tue, 21 Jul 2020 19:58:29 +0000]
remove inventory data

2 years agohandling foreign owned reports of templates to be deleted when they aren't scheduled...
Rogan Hamby [Tue, 21 Jul 2020 19:52:31 +0000]
handling foreign owned reports of templates to be deleted when they aren't scheduled in the future

2 years agoorder of operations improvement on org removal scripts
Rogan Hamby [Tue, 21 Jul 2020 13:52:33 +0000]
order of operations improvement on org removal scripts

2 years agomoving serials before copy templates to resolve an order of operatiosn issue
Rogan Hamby [Tue, 21 Jul 2020 13:42:54 +0000]
moving serials before copy templates to resolve an order of operatiosn issue

2 years agofixing thinko
Rogan Hamby [Tue, 21 Jul 2020 13:28:53 +0000]
fixing thinko

2 years agoadding the create exceeds fines function
Rogan Hamby [Mon, 20 Jul 2020 20:37:56 +0000]
adding the create exceeds fines function

2 years agomake mig-bibstats able to read marcxml or marc21
Rogan Hamby [Tue, 14 Jul 2020 17:32:58 +0000]
make mig-bibstats able to read marcxml or marc21

2 years agoenhancements to mig prepbibs
Rogan Hamby [Tue, 14 Jul 2020 16:56:29 +0000]
enhancements to mig prepbibs

2 years agomoving kmig referene to emig for evergreen version of prepbibs
Rogan Hamby [Tue, 14 Jul 2020 15:33:22 +0000]
moving kmig referene to emig for evergreen version of prepbibs

2 years agomaking the null out columns functions able to handle the term NULL and a single space...
Rogan Hamby [Tue, 14 Jul 2020 13:34:39 +0000]
making the null out columns functions able to handle the term NULL and a single space in case they haven't been trimmed

2 years agoadding emig prepbibs function
Rogan Hamby [Mon, 13 Jul 2020 15:32:49 +0000]
adding emig prepbibs function

2 years agoadding prep bibs to move 999s to 998s
Rogan Hamby [Mon, 13 Jul 2020 15:26:01 +0000]
adding prep bibs to move 999s to 998s

2 years agoadd warning for 999 fields and change name of app to use
Rogan Hamby [Mon, 13 Jul 2020 14:57:38 +0000]
add warning for 999 fields and change name of app to use

2 years agoadd warning for 999 fields
Rogan Hamby [Mon, 13 Jul 2020 14:56:28 +0000]
add warning for 999 fields

2 years agomake a message more meaningful
Rogan Hamby [Mon, 13 Jul 2020 14:48:22 +0000]
make a message more meaningful

2 years agoRevert "moar data"
Jason Etheridge [Tue, 7 Jul 2020 17:46:11 +0000]
Revert "moar data"

This reverts commit 7133775722f9c0c65a40571a3e71a90d2c0a27b2.

2 years agomoar data
Jason Etheridge [Mon, 6 Jul 2020 21:31:41 +0000]
moar data

2 years agohave mig-import remove memcache keys and restart plack
Rogan Hamby [Fri, 26 Jun 2020 16:39:56 +0000]
have mig-import remove memcache keys and restart plack

2 years agominor bugfixs to mig-import
Rogan Hamby [Fri, 26 Jun 2020 16:08:33 +0000]
minor bugfixs to mig-import

2 years agoteach mig-import to bring in message preferences
Rogan Hamby [Thu, 25 Jun 2020 21:38:56 +0000]
teach mig-import to bring in message preferences

2 years agomig-export now does message preferences
Rogan Hamby [Thu, 25 Jun 2020 20:22:58 +0000]
mig-export now does message preferences

2 years agomissed a few lines to cleanup and move ALTER statements to sql_noresult
Rogan Hamby [Thu, 25 Jun 2020 20:04:04 +0000]
missed a few lines to cleanup and move ALTER statements to sql_noresult

2 years agomoving libraries, patroncategories and itemtypes to the front of the restore list...
Rogan Hamby [Thu, 25 Jun 2020 19:55:35 +0000]
moving libraries, patroncategories and itemtypes to the front of the restore list to make sure they are done first

2 years agoteach mig-export to use a sql query function instead of implementing the same lines...
Rogan Hamby [Thu, 25 Jun 2020 19:45:14 +0000]
teach mig-export to use a sql query function instead of implementing the same lines over and over

2 years agoteach mig import to use some funcitons for sql queries to reduce line count and impro...
Rogan Hamby [Thu, 25 Jun 2020 19:24:52 +0000]
teach mig import to use some funcitons for sql queries to reduce line count and improve readability and make a few functions more consistnet in how they check existing data

2 years agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Thu, 25 Jun 2020 18:46:27 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

2 years agomaking restore_itemtypes consistent with using check_itemtype
Rogan Hamby [Thu, 25 Jun 2020 18:46:08 +0000]
making restore_itemtypes consistent with using check_itemtype

2 years agom_upsert_datafield for kmig
Jason Etheridge [Wed, 24 Jun 2020 18:58:01 +0000]
m_upsert_datafield for kmig

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agologic checking category code and item type on isssues and circ rules as well as error log
Rogan Hamby [Fri, 19 Jun 2020 21:19:02 +0000]
logic checking category code and item type on isssues and circ rules as well as error log

2 years agoadd mysql function to remove non-alphanumeric characters
Rogan Hamby [Wed, 17 Jun 2020 13:09:04 +0000]
add mysql function to remove non-alphanumeric characters

2 years agodon't allow systempreferences to be null
Rogan Hamby [Tue, 16 Jun 2020 19:12:50 +0000]
don't allow systempreferences to be null

2 years agoadding letter syncing to kmig import and export
Rogan Hamby [Tue, 16 Jun 2020 18:30:05 +0000]
adding letter syncing to kmig import and export

2 years agom_insert_tag for kmig
Jason Etheridge [Mon, 15 Jun 2020 15:53:00 +0000]
m_insert_tag for kmig

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agofixing typo that caused a false value assignment
Rogan Hamby [Fri, 12 Jun 2020 17:10:53 +0000]
fixing typo that caused a false value assignment

2 years agoa quality of life function to make it easier to modify the fixed fields in a biblio...
Rogan Hamby [Thu, 11 Jun 2020 15:35:09 +0000]
a quality of life function to make it easier to modify the fixed fields in a biblio.record_entry record

2 years agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Wed, 10 Jun 2020 17:42:04 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

2 years agoadding better category support to authorised values import/export in kmig
Rogan Hamby [Wed, 10 Jun 2020 17:41:47 +0000]
adding better category support to authorised values import/export in kmig

2 years agokoha function for updating the 003 tag
Jason Etheridge [Tue, 9 Jun 2020 19:35:29 +0000]
koha function for updating the 003 tag

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agofixed help error in mig-stagebibs for emig
Rogan Hamby [Mon, 8 Jun 2020 16:42:25 +0000]
fixed help error in mig-stagebibs for emig

2 years agofixing on mung_sf9 where it declares int instead of bigint for bib ids
Rogan Hamby [Mon, 8 Jun 2020 16:19:10 +0000]
fixing on mung_sf9 where it declares int instead of bigint for bib ids

2 years agoadding a strip subfield function
Rogan Hamby [Mon, 8 Jun 2020 16:17:59 +0000]
adding a strip subfield function

2 years agomig-import missed a clause for deleting from the itemtypes table
Rogan Hamby [Wed, 3 Jun 2020 15:39:14 +0000]
mig-import missed a clause for deleting from the itemtypes table

2 years agofixed xpath issues with restore_itemtypes
Rogan Hamby [Wed, 3 Jun 2020 15:10:41 +0000]
fixed xpath issues with restore_itemtypes

2 years agoadded to kmig bookseller and budget support to import and export
Rogan Hamby [Tue, 2 Jun 2020 20:15:34 +0000]
added to kmig bookseller and budget support to import and export

2 years agoadding the start of base sql and marc functions for koha to mig-init
Rogan Hamby [Tue, 2 Jun 2020 13:49:23 +0000]
adding the start of base sql and marc functions for koha to mig-init

2 years agoadding the start of base sql and marc functions for koha to mig-init
Rogan Hamby [Tue, 2 Jun 2020 13:49:08 +0000]
adding the start of base sql and marc functions for koha to mig-init

2 years agobase staging tables for koha added for kmig.d/init
Rogan Hamby [Tue, 2 Jun 2020 13:42:49 +0000]
base staging tables for koha added for kmig.d/init

2 years agoreplace borrower_attributes with borrowerattributes for file name in mig-export
Rogan Hamby [Thu, 28 May 2020 17:46:35 +0000]
replace borrower_attributes with borrowerattributes for file name in mig-export

2 years agoadding borrower attributes to mig import/export
Rogan Hamby [Wed, 27 May 2020 20:33:51 +0000]
adding borrower attributes to mig import/export

2 years agoadding m_ for koha functions and an update_leader function
Rogan Hamby [Wed, 27 May 2020 15:52:37 +0000]
adding m_ for koha functions and an update_leader function

2 years agokmig import/export now support syncing reports
Rogan Hamby [Thu, 21 May 2020 20:58:28 +0000]
kmig import/export now support syncing reports

2 years agovarious enhacnements to emig bibstats including adding it to kmig
Rogan Hamby [Tue, 19 May 2020 20:16:03 +0000]
various enhacnements to emig bibstats including adding it to kmig

2 years agoadded profile for Destiny to mig bibstats
Rogan Hamby [Tue, 19 May 2020 17:21:33 +0000]
added profile for Destiny to mig bibstats

2 years agoadjust -test components of kohacatalog.com domains in kmig import
Rogan Hamby [Thu, 7 May 2020 14:41:01 +0000]
adjust -test components of kohacatalog.com domains in kmig import

2 years agoadd some new koha reports
Rogan Hamby [Tue, 5 May 2020 19:17:01 +0000]
add some new koha reports

2 years agochange default behavior for no --analyst tag
Rogan Hamby [Mon, 4 May 2020 19:33:36 +0000]
change default behavior for no --analyst tag

2 years agoset ->do('SET NAMES utf8mb4'); by default
Rogan Hamby [Mon, 4 May 2020 15:50:38 +0000]
set ->do('SET NAMES utf8mb4'); by default

2 years agomore robust versions of kmig import and export
Rogan Hamby [Mon, 4 May 2020 15:49:40 +0000]
more robust versions of kmig import and export

2 years agosimplify a few exports and add one for itemtypes
Rogan Hamby [Wed, 22 Apr 2020 19:10:20 +0000]
simplify a few exports and add one for itemtypes

2 years agoupdated mig export to use xml and mig import supports libraries and preferences
Rogan Hamby [Wed, 22 Apr 2020 17:57:34 +0000]
updated mig export to use xml and mig import supports libraries and preferences

2 years agoupdated mig export to use xml and mig import supports libraries and preferences
Rogan Hamby [Wed, 22 Apr 2020 17:57:22 +0000]
updated mig export to use xml and mig import supports libraries and preferences

2 years agoinitial version of mig-export added for kmig
Rogan Hamby [Fri, 17 Apr 2020 16:22:50 +0000]
initial version of mig-export added for kmig

2 years agounneeded variable declaration removed
Rogan Hamby [Thu, 16 Apr 2020 18:54:00 +0000]
unneeded variable declaration removed

2 years agoremoving no longer needed parameter
Rogan Hamby [Thu, 16 Apr 2020 18:51:43 +0000]
removing no longer needed parameter

2 years agodon't index x_count if we see it
Jason Etheridge [Thu, 16 Apr 2020 14:38:14 +0000]
don't index x_count if we see it

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agodefault charset and collate for csv2mysql
Jason Etheridge [Thu, 16 Apr 2020 14:36:45 +0000]
default charset and collate for csv2mysql

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agofirst cut of kmig-quick
Jason Etheridge [Thu, 16 Apr 2020 13:48:16 +0000]
first cut of kmig-quick

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agoseed kmig-quick with emig-quick
Jason Etheridge [Thu, 16 Apr 2020 13:47:29 +0000]
seed kmig-quick with emig-quick

2 years agoif we come across these, make them BIGINT. mysql/mariadb can't index TEXT
Jason Etheridge [Wed, 15 Apr 2020 20:32:46 +0000]
if we come across these, make them BIGINT. mysql/mariadb can't index TEXT

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agomake sure worksheet names do not go over 31 characters
Jason Etheridge [Wed, 15 Apr 2020 20:31:11 +0000]
make sure worksheet names do not go over 31 characters

2 years agosimplifying defaults a bit
Rogan Hamby [Wed, 15 Apr 2020 18:11:06 +0000]
simplifying defaults a bit

2 years agoadding kmig reporter
Rogan Hamby [Wed, 15 Apr 2020 18:09:17 +0000]
adding kmig reporter

2 years agowe don't need to pre-create Koha staging tables since mig link and mig stage can... kmig
Jason Etheridge [Fri, 10 Apr 2020 21:00:42 +0000]
we don't need to pre-create Koha staging tables since mig link and mig stage can do it

2 years agofirst cut of kmig-stage, and tweak kmig-link to allow linking to non-existent parent...
Jason Etheridge [Fri, 10 Apr 2020 21:00:12 +0000]
first cut of kmig-stage, and tweak kmig-link to allow linking to non-existent parent tables, since based on the naming convention we can vivicate them

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agoseed kmig-stage with emig-stage
Jason Etheridge [Fri, 10 Apr 2020 20:48:24 +0000]
seed kmig-stage with emig-stage

2 years agofirst cut of csv2mysql, mig-convert, and a needed tweak for mig-sql
Jason Etheridge [Fri, 10 Apr 2020 20:47:09 +0000]
first cut of csv2mysql, mig-convert, and a needed tweak for mig-sql

2 years agomove csv2mysql into the kmig hierarchy so we can better leverage KMig.pm
Jason Etheridge [Fri, 10 Apr 2020 20:03:57 +0000]
move csv2mysql into the kmig hierarchy so we can better leverage KMig.pm

2 years agoseed csv2mysql with csv2sql
Jason Etheridge [Fri, 10 Apr 2020 20:01:53 +0000]
seed csv2mysql with csv2sql

2 years agoseed kmig-convert with emig-convert
Jason Etheridge [Fri, 10 Apr 2020 19:53:43 +0000]
seed kmig-convert with emig-convert

2 years agofirst cut of kmig-unlink
Jason Etheridge [Fri, 10 Apr 2020 19:31:31 +0000]
first cut of kmig-unlink

2 years agoseed kmig-unlink with emig-unlink
Jason Etheridge [Fri, 10 Apr 2020 19:29:44 +0000]
seed kmig-unlink with emig-unlink

2 years agofirst cut of kmig-link
Jason Etheridge [Fri, 10 Apr 2020 19:29:18 +0000]
first cut of kmig-link

2 years agoseed kmig-link with emig-link
Jason Etheridge [Fri, 10 Apr 2020 19:21:48 +0000]
seed kmig-link with emig-link

2 years agomore path touchups
Jason Etheridge [Fri, 10 Apr 2020 19:20:37 +0000]
more path touchups

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

2 years agomig wrapper to kmig/emig
Jason Etheridge [Fri, 10 Apr 2020 18:44:58 +0000]
mig wrapper to kmig/emig

It won't handle first time setup; you'll need to call emig or kmig explicitly
until an environment is loaded.

Example:

    kmig env create demo
    kmig env use demo
    mig init
    mig add foo.txt etc

Also, the older ~/.mig environment directory, if used with the new mig, will
need to be moved or merged into ~/.emig, and the various *.env files ammended
with:

    export MIGCMD=emig

2 years agorewire to match the new naming scheme and layout
Jason Etheridge [Fri, 10 Apr 2020 18:28:17 +0000]
rewire to match the new naming scheme and layout

2 years agolet's not name these differently than the emig.d/ counterparts
Jason Etheridge [Fri, 10 Apr 2020 18:13:08 +0000]
let's not name these differently than the emig.d/ counterparts

2 years agotoward renaming mig to emig and tweaking the directory layout
Jason Etheridge [Fri, 10 Apr 2020 18:05:56 +0000]
toward renaming mig to emig and tweaking the directory layout

2 years agofirst cuts of kmig-*iconv
Jason Etheridge [Fri, 10 Apr 2020 17:57:28 +0000]
first cuts of kmig-*iconv