migration-tools.git
4 years agoadding branch mapping for tlc
Rogan Hamby [Thu, 1 Mar 2018 20:28:44 +0000]
adding branch mapping for tlc

4 years agoremoving phones from tlc mapping
Rogan Hamby [Thu, 1 Mar 2018 18:19:51 +0000]
removing phones from tlc mapping

4 years agoadding variant add subfield 9 that work only on tags with a 856 that matches conditio...
Rogan Hamby [Wed, 28 Feb 2018 20:53:07 +0000]
adding variant add subfield 9 that work only on tags with a 856 that matches condition passed as parameter

4 years agoadding bib manipulations table
Rogan Hamby [Wed, 28 Feb 2018 20:18:25 +0000]
adding bib manipulations table

4 years agomoving org to the holding code table
Rogan Hamby [Wed, 28 Feb 2018 18:26:42 +0000]
moving org to the holding code table

4 years agoadding x_shelf and x_org to the shelving location init table
Rogan Hamby [Wed, 28 Feb 2018 17:59:01 +0000]
adding x_shelf and x_org to the shelving location init table

4 years agoensure we don't use deleted copy locations
Jason Etheridge [Tue, 27 Feb 2018 21:26:09 +0000]
ensure we don't use deleted copy locations

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agofind shelf function
Rogan Hamby [Tue, 27 Feb 2018 20:59:12 +0000]
find shelf function

4 years agofixing column name in common gsheet tables
Rogan Hamby [Tue, 27 Feb 2018 20:16:54 +0000]
fixing column name in common gsheet tables

4 years agochanges to make some tables child tables
Rogan Hamby [Tue, 27 Feb 2018 19:28:59 +0000]
changes to make some tables child tables

4 years agoadding text string for mig sql via :migschema_text
Rogan Hamby [Tue, 27 Feb 2018 17:57:45 +0000]
adding text string for mig sql via :migschema_text

4 years agoupdating column name from copy_location to desired_shelf to match mig tools
Rogan Hamby [Tue, 27 Feb 2018 17:04:22 +0000]
updating column name from copy_location to desired_shelf to match mig tools

4 years agoadding load report file for resource mate
Rogan Hamby [Tue, 27 Feb 2018 16:34:46 +0000]
adding load report file for resource mate

4 years agofixing some tlc maapping table bugs
Rogan Hamby [Tue, 27 Feb 2018 16:34:04 +0000]
fixing some tlc maapping table bugs

4 years agotaking out some dumper statements for troubleshooting that I had commented out
Rogan Hamby [Tue, 27 Feb 2018 16:09:29 +0000]
taking out some dumper statements for troubleshooting that I had commented out

4 years agoimproving tool tip
Rogan Hamby [Tue, 27 Feb 2018 14:26:19 +0000]
improving tool tip

4 years agofixed bug with not all tags converting to lowercase
Rogan Hamby [Mon, 26 Feb 2018 21:02:20 +0000]
fixed bug with not all tags converting to lowercase

4 years agoreplacing mig_schema with MIGSCHEMA per IRC decision
Rogan Hamby [Mon, 26 Feb 2018 20:54:48 +0000]
replacing mig_schema with MIGSCHEMA per IRC decision

4 years agofixed pathing issue with finding xml files
Rogan Hamby [Mon, 26 Feb 2018 20:45:12 +0000]
fixed pathing issue with finding xml files

4 years agomigration_tools.handle_actor_sc_and_sce
Jason Etheridge [Mon, 26 Feb 2018 05:38:12 +0000]
migration_tools.handle_actor_sc_and_sce

and migration_tools.vivicate_actor_sc_and_sce, though may want to tweak the
former to invoke the latter

This incarnation takes an org shortname as the last argument, but I want to
make a variant that looks for x_org in case we're doing branch level stat
cats, etc.

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agomigration_tools.handle_profile
Jason Etheridge [Mon, 26 Feb 2018 04:33:35 +0000]
migration_tools.handle_profile

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agomigration_tools.handle_not_migrate
Jason Etheridge [Mon, 26 Feb 2018 04:27:10 +0000]
migration_tools.handle_not_migrate

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agomigration_tools.handle_circmod
Jason Etheridge [Mon, 26 Feb 2018 04:10:28 +0000]
migration_tools.handle_circmod

for example:

select migration_tools.handle_circmod(:'migschema','map_item_l_location_clean');

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agomigration_tools.handle_shelf
Jason Etheridge [Mon, 26 Feb 2018 04:02:42 +0000]
migration_tools.handle_shelf

for example:

mig sql -c "select migration_tools.handle_shelf(:'migschema','map_item_l_location_clean','ORGSHORTNAME',1);"

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agosupport for some argument pass-thru for mig-quick
Jason Etheridge [Mon, 26 Feb 2018 02:30:32 +0000]
support for some argument pass-thru for mig-quick

4 years agomig-quick for doing the add/skip-iconv/clean/convert/stage dance without any argument...
Jason Etheridge [Sun, 25 Feb 2018 23:02:16 +0000]
mig-quick for doing the add/skip-iconv/clean/convert/stage dance without any arguments (for now)

4 years agodefault to tab for field separator for unaligned text
Jason Etheridge [Tue, 20 Feb 2018 16:54:46 +0000]
default to tab for field separator for unaligned text

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agotruncate field names here for now for WriteExcel
Jason Etheridge [Fri, 16 Feb 2018 21:29:34 +0000]
truncate field names here for now for WriteExcel

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agoconsolidating tracking tables for gsheet
Rogan Hamby [Fri, 16 Feb 2018 21:25:37 +0000]
consolidating tracking tables for gsheet

4 years agomoving tlc init file
Rogan Hamby [Fri, 16 Feb 2018 20:26:30 +0000]
moving tlc init file

4 years agotlc mapping sql
Rogan Hamby [Fri, 16 Feb 2018 19:33:23 +0000]
tlc mapping sql

4 years agorolling back some changes I made
Rogan Hamby [Fri, 16 Feb 2018 19:33:00 +0000]
rolling back some changes I made

4 years agoadjusted universal files to no longer need fields from tracked tables that were dropped
Rogan Hamby [Fri, 16 Feb 2018 19:15:51 +0000]
adjusted universal files to no longer need fields from tracked tables that were dropped

4 years agomaking the common tables more mig sql smart
Rogan Hamby [Fri, 16 Feb 2018 17:29:51 +0000]
making the common tables more mig sql smart

4 years agoadd migscheam local variable to invocation
Rogan Hamby [Fri, 16 Feb 2018 17:23:37 +0000]
add migscheam local variable to invocation

4 years agocommenting out the other way of invoking path
Rogan Hamby [Fri, 16 Feb 2018 16:52:11 +0000]
commenting out the other way of invoking path

4 years agoadd mig-sql the show path
Rogan Hamby [Fri, 16 Feb 2018 16:36:13 +0000]
add mig-sql the show path

4 years agocommon tables that will be used by gsheet
Rogan Hamby [Fri, 16 Feb 2018 16:08:08 +0000]
common tables that will be used by gsheet

4 years agomoving config into else clause for cleanliness
Rogan Hamby [Mon, 12 Feb 2018 19:17:33 +0000]
moving config into else clause for cleanliness

4 years agofixing typo and moving grab file into else clause
Rogan Hamby [Mon, 12 Feb 2018 19:16:37 +0000]
fixing typo and moving grab file into else clause

4 years agomade csv2sql mig aware
Rogan Hamby [Mon, 12 Feb 2018 16:50:21 +0000]
made csv2sql mig aware

4 years agoadding a report package for an overview of system data like that done in migrations
Rogan Hamby [Mon, 12 Feb 2018 16:02:31 +0000]
adding a report package for an overview of system data like that done in migrations

4 years agofix typo and add some security to output format
Rogan Hamby [Sun, 11 Feb 2018 23:07:46 +0000]
fix typo and add some security to output format

4 years agofixing doc
Rogan Hamby [Fri, 9 Feb 2018 22:04:16 +0000]
fixing doc

4 years agominor fixes to gsheet
Rogan Hamby [Fri, 9 Feb 2018 20:59:45 +0000]
minor fixes to gsheet

4 years agoadding the mig gsheet main file
Rogan Hamby [Fri, 9 Feb 2018 20:46:26 +0000]
adding the mig gsheet main file

4 years agoadding mig gsheet
Rogan Hamby [Fri, 9 Feb 2018 20:46:05 +0000]
adding mig gsheet

4 years agoclean up reporter share withs in remove ou scripts
Rogan Hamby [Fri, 9 Feb 2018 15:09:03 +0000]
clean up reporter share withs in remove ou scripts

4 years agostart of serial script in remove ou
Rogan Hamby [Fri, 9 Feb 2018 14:44:19 +0000]
start of serial script in remove ou

4 years agostart of distinct acq removal file
Rogan Hamby [Fri, 9 Feb 2018 13:44:59 +0000]
start of distinct acq removal file

4 years agoadmin user sanity check added to remove ou scripts
Rogan Hamby [Fri, 9 Feb 2018 13:23:52 +0000]
admin user sanity check added to remove ou scripts

4 years agomaking the user delete information a bit more robust
Rogan Hamby [Fri, 9 Feb 2018 13:18:14 +0000]
making the user delete information a bit more robust

4 years agomoving some cross saved templates and output folders
Rogan Hamby [Fri, 9 Feb 2018 13:14:37 +0000]
moving some cross saved templates and output folders

4 years agoadded location for added page file to be miggitdir
Rogan Hamby [Thu, 8 Feb 2018 19:51:49 +0000]
added location for added page file to be miggitdir

4 years agoadded reporter documentation to mig
Rogan Hamby [Thu, 8 Feb 2018 19:49:25 +0000]
added reporter documentation to mig

4 years agoinitial working branch for mig reporter
Rogan Hamby [Thu, 8 Feb 2018 19:39:22 +0000]
initial working branch for mig reporter

4 years agoadd removal of copy tag stuff from remove ou scripts
Rogan Hamby [Wed, 31 Jan 2018 13:47:22 +0000]
add removal of copy tag stuff from remove ou scripts

4 years agoadding last pushed timestamp to gsheet tracked table
Rogan Hamby [Tue, 30 Jan 2018 14:24:58 +0000]
adding last pushed timestamp to gsheet tracked table

4 years agoadd unique constraint for worksheet and tab name in ghseet tracked table
Rogan Hamby [Tue, 30 Jan 2018 14:23:34 +0000]
add unique constraint for worksheet and tab name in ghseet tracked table

4 years agoadding primary key to gsheet_tracked_table
Rogan Hamby [Tue, 30 Jan 2018 14:15:17 +0000]
adding primary key to gsheet_tracked_table

4 years agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Mon, 29 Jan 2018 20:54:13 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

4 years agogsheet blobs for mig init directory
Rogan Hamby [Mon, 29 Jan 2018 20:53:54 +0000]
gsheet blobs for mig init directory

4 years agosimplify arguments for mig-skip-iconv and mig-skip-clean
Jason Etheridge [Mon, 29 Jan 2018 20:51:29 +0000]
simplify arguments for mig-skip-iconv and mig-skip-clean

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agochanging sequence of loading bibs so that newest bibs are prioritized which helps...
Rogan Hamby [Fri, 19 Jan 2018 16:13:27 +0000]
changing sequence of loading bibs so that newest bibs are prioritized which helps the catalogers

4 years agoremove check for wait since it is defined by default now and add it to loading auths...
Rogan Hamby [Tue, 16 Jan 2018 22:08:15 +0000]
remove check for wait since it is defined by default now and add it to loading auths as well

4 years agosummary table and subtables as an output option for quicksheet
Jason Etheridge [Fri, 12 Jan 2018 21:39:00 +0000]
summary table and subtables as an output option for quicksheet

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agoinit/ subdirectory for mig-sql/, so we can more conveniently store sql for other...
Jason Etheridge [Fri, 12 Jan 2018 15:58:44 +0000]
init/ subdirectory for mig-sql/, so we can more conveniently store sql for other mig commands

4 years agoRevert "quicksheet experiment, do not omit tabs based on number of unique values"
Jason Etheridge [Fri, 5 Jan 2018 20:37:44 +0000]
Revert "quicksheet experiment, do not omit tabs based on number of unique values"

This reverts commit 90c43c93714655ffad0bce2b34934b4c0e367f9e.

4 years agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Fri, 15 Dec 2017 18:34:48 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

4 years agoadding some basic copy tag and serial tables to the mig init function
Rogan Hamby [Fri, 15 Dec 2017 18:34:26 +0000]
adding some basic copy tag and serial tables to the mig init function

4 years agoget_marc_leader()
Jason Etheridge [Wed, 6 Dec 2017 04:54:41 +0000]
get_marc_leader()

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agofunction for setting passwords in actor.passwd quickly
Rogan Hamby [Wed, 29 Nov 2017 14:52:49 +0000]
function for setting passwords in actor.passwd quickly

4 years agobetter regexp for grabbing field names, redux
Jason Etheridge [Mon, 27 Nov 2017 22:42:16 +0000]
better regexp for grabbing field names, redux

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agobetter regexp for grabbing field names
Jason Etheridge [Mon, 27 Nov 2017 22:35:57 +0000]
better regexp for grabbing field names

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agoquicksheet experiment, do not omit tabs based on number of unique values
Jason Etheridge [Mon, 27 Nov 2017 22:21:48 +0000]
quicksheet experiment, do not omit tabs based on number of unique values

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agoupdate unicorn holdings example
Jason Etheridge [Mon, 27 Nov 2017 20:41:04 +0000]
update unicorn holdings example

4 years agoexample cleanup
Jason Etheridge [Mon, 27 Nov 2017 20:19:30 +0000]
example cleanup

4 years agoexample holdings map for Unicorn/Symphony
Jason Etheridge [Mon, 27 Nov 2017 20:15:31 +0000]
example holdings map for Unicorn/Symphony

4 years agooverzealous heuristic
Jason Etheridge [Wed, 8 Nov 2017 02:06:55 +0000]
overzealous heuristic

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agotoward better name parsing (handles names like "Van Horn, Fiona")
Jason Etheridge [Wed, 11 Oct 2017 08:40:44 +0000]
toward better name parsing (handles names like "Van Horn, Fiona")

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agotoward better name parsing (handles names like "Van Horn, Fiona")
Jason Etheridge [Wed, 11 Oct 2017 07:55:36 +0000]
toward better name parsing (handles names like "Van Horn, Fiona")

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agocomment
Jason Etheridge [Tue, 3 Oct 2017 19:07:14 +0000]
comment

4 years agopush bib sequence and return starting value for reserved range
Jason Etheridge [Tue, 3 Oct 2017 19:05:35 +0000]
push bib sequence and return starting value for reserved range

4 years agoMerge branch 'master' of git.esilibrary.com:migration-tools
Jason Etheridge [Tue, 3 Oct 2017 18:33:58 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

4 years agofix mig-init
Jason Etheridge [Tue, 3 Oct 2017 18:33:47 +0000]
fix mig-init

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agoadding actor.usr_setting to production tables
Rogan Hamby [Tue, 26 Sep 2017 13:03:59 +0000]
adding actor.usr_setting to production tables

4 years agomigration_tools.attempt_sierra_timestamp
Jason Etheridge [Mon, 11 Sep 2017 07:34:18 +0000]
migration_tools.attempt_sierra_timestamp

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agomore address parsing helpers
Jason Etheridge [Mon, 11 Sep 2017 02:58:51 +0000]
more address parsing helpers

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agopsql variable for :migschema
Jason Etheridge [Sat, 9 Sep 2017 02:51:38 +0000]
psql variable for :migschema

mig-sql already puts the migration schema in the search path, but
this can be useful for things like

    creator = (SELECT id FROM actor_usr WHERE usrname = :'migschema' || '_admin')

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agomultiple file support for mig-quicksheet
Jason Etheridge [Mon, 28 Aug 2017 19:22:49 +0000]
multiple file support for mig-quicksheet

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agomig-init: loop through sorted mig-sql/ directory
Jason Etheridge [Wed, 23 Aug 2017 20:45:15 +0000]
mig-init: loop through sorted mig-sql/ directory

mig-init will look for .sql files in mig-sql to run

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agomig-sql: silence warning if no $BIBSTART
Jason Etheridge [Wed, 23 Aug 2017 20:42:32 +0000]
mig-sql: silence warning if no $BIBSTART

4 years agomig-env: set PGOPTIONS for search_path
Jason Etheridge [Tue, 8 Aug 2017 14:29:04 +0000]
mig-env: set PGOPTIONS for search_path

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agoextract_holdings: --suffix support
Jason Etheridge [Tue, 8 Aug 2017 13:42:28 +0000]
extract_holdings: --suffix support

helps when you need to extract tag data from multiple MARC sources in a given migration

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agoadding deletion of extra permissions and groups for users in remove ou scripts
Rogan Hamby [Thu, 3 Aug 2017 19:57:46 +0000]
adding deletion of extra permissions and groups for users in remove ou scripts

4 years agoadding basic program to convert from Apollo LDF to staging tables
Rogan Hamby [Thu, 3 Aug 2017 19:28:57 +0000]
adding basic program to convert from Apollo LDF to staging tables

4 years agoadding deletion of surveys to remove ou scripts
Rogan Hamby [Thu, 3 Aug 2017 19:23:38 +0000]
adding deletion of surveys to remove ou scripts

4 years agofix -fs, and more output when fixing stuff
Jason Etheridge [Thu, 29 Jun 2017 18:50:07 +0000]
fix -fs, and more output when fixing stuff

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

4 years agosome marc mappings for III Sierra
Jason Etheridge [Thu, 29 Jun 2017 17:01:44 +0000]
some marc mappings for III Sierra

4 years agomig-sql: pass through the BIBSTART env variable
Jason Etheridge [Thu, 29 Jun 2017 15:57:45 +0000]
mig-sql: pass through the BIBSTART env variable

available as :bibstart

Signed-off-by: Jason Etheridge <jason@esilibrary.com>