migration-tools.git
14 years agomove copy location mapping functionality into base.sql
Jason Etheridge [Wed, 12 Aug 2009 05:11:04 +0000]
move copy location mapping functionality into base.sql

14 years agomove dynamic item mapping functionality to base.sql; it's not ILS specific
Jason Etheridge [Wed, 12 Aug 2009 04:58:48 +0000]
move dynamic item mapping functionality to base.sql; it's not ILS specific

14 years agothis stored procedure is a true function with no side effects
Jason Etheridge [Tue, 11 Aug 2009 10:39:15 +0000]
this stored procedure is a true function with no side effects

14 years agoname parser
Jason Etheridge [Tue, 11 Aug 2009 10:37:09 +0000]
name parser

14 years agofix signature
Jason Etheridge [Sat, 8 Aug 2009 22:52:13 +0000]
fix signature

14 years agostart moving this mapping functionality over to base, since the only part that is...
Jason Etheridge [Sat, 8 Aug 2009 22:41:00 +0000]
start moving this mapping functionality over to base, since the only part that is ILS specific is the data that drives it

14 years agoMDMP require version bumped
Shawn Boyette [Mon, 27 Jul 2009 16:06:22 +0000]
MDMP require version bumped
believe non-holding multis work now
null non-holdings data handled better

14 years ago1.005
Shawn Boyette [Mon, 27 Jul 2009 16:06:21 +0000]
1.005
added 'ignoremulti' modifier
mods handling slightly tweaked

14 years agonewline at end of sample run
Shawn Boyette [Tue, 14 Jul 2009 03:07:46 +0000]
newline at end of sample run

14 years ago--marcfile no longer gets -m; --map does
Shawn Boyette [Mon, 13 Jul 2009 18:14:12 +0000]
--marcfile no longer gets -m; --map does

14 years agoautoset marcfile on prefix
Shawn Boyette [Thu, 9 Jul 2009 16:29:41 +0000]
autoset marcfile on prefix

14 years agooopses
Shawn Boyette [Thu, 9 Jul 2009 14:24:34 +0000]
oopses

14 years agoredo
Shawn Boyette [Thu, 9 Jul 2009 14:09:18 +0000]
redo

14 years agoredoing previous changes
Shawn Boyette [Thu, 9 Jul 2009 14:09:17 +0000]
redoing previous changes

14 years agorescued changes
Shawn Boyette [Thu, 9 Jul 2009 13:56:41 +0000]
rescued changes

14 years agoyanking DBM::Deep stuffs
Shawn Boyette [Thu, 25 Jun 2009 17:31:51 +0000]
yanking DBM::Deep stuffs

14 years agoremoving DBMD, phase I
Shawn Boyette [Thu, 25 Jun 2009 17:31:50 +0000]
removing DBMD, phase I

14 years agoold2new generation now handles controlfields and will map any number of matches,...
Shawn Boyette [Wed, 24 Jun 2009 19:20:19 +0000]
old2new generation now handles controlfields and will map any number of matches, not just one-per-record

14 years agotweaks
Shawn Boyette [Wed, 24 Jun 2009 19:20:19 +0000]
tweaks

14 years agotypo fix
Shawn Boyette [Wed, 24 Jun 2009 19:20:19 +0000]
typo fix

14 years agoimproved multifile handling
Shawn Boyette [Wed, 24 Jun 2009 19:20:18 +0000]
improved multifile handling

14 years agomulti extractions work now. holding seq# always included now
Shawn Boyette [Wed, 24 Jun 2009 19:20:18 +0000]
multi extractions work now. holding seq# always included now

14 years agomaking sampling work better
Shawn Boyette [Wed, 24 Jun 2009 19:20:17 +0000]
making sampling work better

14 years agoadded subs thresholding
Shawn Boyette [Wed, 24 Jun 2009 19:20:17 +0000]
added subs thresholding

14 years agoversion bump
Shawn Boyette [Wed, 24 Jun 2009 19:20:16 +0000]
version bump

14 years agofixes for multi subfields
Shawn Boyette [Wed, 24 Jun 2009 19:20:16 +0000]
fixes for multi subfields
added get_multis method

14 years agoautoflush turned off for DBM::Deep
Shawn Boyette [Wed, 24 Jun 2009 19:20:15 +0000]
autoflush turned off for DBM::Deep
name method doesn't require rec# anymore
{names} gone from record dataset

14 years agotest for existing DBMD file; die
Shawn Boyette [Thu, 18 Jun 2009 18:23:37 +0000]
test for existing DBMD file; die

14 years agoset default window size to 9 lines
Shawn Boyette [Thu, 18 Jun 2009 18:23:36 +0000]
set default window size to 9 lines

14 years agoholdings dump status msg now counts holdings instead of records
Shawn Boyette [Thu, 18 Jun 2009 18:23:35 +0000]
holdings dump status msg now counts holdings instead of records

14 years agoworks with new MDMP
Shawn Boyette [Fri, 12 Jun 2009 18:30:37 +0000]
works with new MDMP

14 years agotake rcnt out of dstore and call it reccount
Shawn Boyette [Fri, 12 Jun 2009 18:30:36 +0000]
take rcnt out of dstore and call it reccount

14 years agochanged rptr to rcnt
Shawn Boyette [Fri, 12 Jun 2009 18:30:36 +0000]
changed rptr to rcnt

14 years agoargs handling bug
Shawn Boyette [Fri, 12 Jun 2009 18:30:36 +0000]
args handling bug

14 years agoKeeping MDMP from eating all teh rams (WIP)
Shawn Boyette [Fri, 12 Jun 2009 18:30:35 +0000]
Keeping MDMP from eating all teh rams (WIP)

14 years agoscope tweaking
Shawn Boyette [Fri, 12 Jun 2009 18:30:34 +0000]
scope tweaking

14 years ago1.003 No longer purely OO, to allow XML::Twig to run in handler mode (cuts memory...
Shawn Boyette [Fri, 12 Jun 2009 18:30:34 +0000]
1.003 No longer purely OO, to allow XML::Twig to run in handler mode (cuts memory usage from 2G+ to ~25M for full sampling

14 years agotest fixes for 1.003
Shawn Boyette [Fri, 12 Jun 2009 18:30:33 +0000]
test fixes for 1.003

14 years agochangelog
Shawn Boyette [Wed, 10 Jun 2009 16:54:28 +0000]
changelog

14 years ago1.002 if any instance of a sub has a value, that should now appear in detail sample...
Shawn Boyette [Wed, 10 Jun 2009 16:54:27 +0000]
1.002 if any instance of a sub has a value, that should now appear in detail sample output

14 years agosubfield report added to detail
Shawn Boyette [Fri, 29 May 2009 21:14:33 +0000]
subfield report added to detail

14 years agosbufield lengthtracking implemented
Shawn Boyette [Fri, 29 May 2009 21:14:32 +0000]
sbufield lengthtracking implemented

14 years ago1.001 changed sample detail format to one which can be dumped directly into a dokuwik...
Shawn Boyette [Wed, 27 May 2009 17:01:29 +0000]
1.001 changed sample detail format to one which can be dumped directly into a dokuwiki page

14 years agomulti hash now uses just code for key
Shawn Boyette [Wed, 27 May 2009 15:35:12 +0000]
multi hash now uses just code for key

14 years agocruddy temporary fix while multi is sorted out
Shawn Boyette [Wed, 27 May 2009 15:35:11 +0000]
cruddy temporary fix while multi is sorted out

14 years agotrying to fix memory problems, but barkingup wrong tree
Shawn Boyette [Fri, 22 May 2009 14:47:20 +0000]
trying to fix memory problems, but barkingup wrong tree

14 years agoSTL now prints file name on fail open
Shawn Boyette [Fri, 22 May 2009 14:47:20 +0000]
STL now prints file name on fail open

14 years agothis is actually bearable with \set verbosity terse
Jason Etheridge [Wed, 20 May 2009 03:35:33 +0000]
this is actually bearable with \set verbosity terse

14 years agoimproved error reporting
Shawn Boyette [Wed, 13 May 2009 14:48:49 +0000]
improved error reporting

14 years agofix for undef value in regex
Shawn Boyette [Wed, 13 May 2009 14:48:48 +0000]
fix for undef value in regex

14 years agocleanup before new work
Shawn Boyette [Thu, 7 May 2009 16:17:51 +0000]
cleanup before new work

14 years agofixes
Shawn Boyette [Wed, 6 May 2009 20:59:12 +0000]
fixes

14 years agoworks (pretty much)
Shawn Boyette [Wed, 6 May 2009 20:58:45 +0000]
works (pretty much)

14 years agotmap updates
Shawn Boyette [Tue, 5 May 2009 20:27:38 +0000]
tmap updates

14 years agosample stuffs working pretty good now
Shawn Boyette [Tue, 5 May 2009 16:43:45 +0000]
sample stuffs working pretty good now

14 years agofixes to tag counts
Shawn Boyette [Tue, 5 May 2009 16:32:18 +0000]
fixes to tag counts

14 years agomisc
Shawn Boyette [Tue, 5 May 2009 15:12:05 +0000]
misc

14 years agosample routines basically working
Shawn Boyette [Tue, 5 May 2009 15:00:01 +0000]
sample routines basically working

14 years agofergot semicolon derrrrr
Shawn Boyette [Thu, 30 Apr 2009 14:33:52 +0000]
fergot semicolon derrrrr

14 years agodoc updates
Shawn Boyette [Thu, 30 Apr 2009 14:33:08 +0000]
doc updates

14 years agofilters in MDMP
Shawn Boyette [Thu, 30 Apr 2009 01:49:35 +0000]
filters in MDMP

14 years agosingle-chunk tokens being quoted is ok now. misc other fixes
Shawn Boyette [Thu, 30 Apr 2009 01:33:00 +0000]
single-chunk tokens being quoted is ok now. misc other fixes

14 years agoinitial checkin
Shawn Boyette [Wed, 29 Apr 2009 23:43:01 +0000]
initial checkin

14 years agoyanking bib references; adding tag map to MDMP; cleanup and new test corpus data
Shawn Boyette [Wed, 29 Apr 2009 20:01:38 +0000]
yanking bib references; adding tag map to MDMP; cleanup and new test corpus data

14 years agowhen looking for date in 260$c, non-numerics are now removed to improve quality of...
Shawn Boyette [Wed, 29 Apr 2009 15:51:26 +0000]
when looking for date in 260$c, non-numerics are now removed to improve quality of data

14 years agoadding marcxml namespace to the wrapping collection element
Mike Rylander [Wed, 29 Apr 2009 15:22:08 +0000]
adding marcxml namespace to the wrapping collection element

14 years agobirthing MARCXMLSampler
Shawn Boyette [Tue, 28 Apr 2009 02:31:51 +0000]
birthing MARCXMLSampler

14 years ago1.001 generate now takes 2 arguments: a filename or string, and any true value if...
Shawn Boyette [Mon, 27 Apr 2009 19:21:56 +0000]
1.001 generate now takes 2 arguments: a filename or string, and any true value if the first argument is a string, to indicate that fact

14 years agoremoving sample tests
Shawn Boyette [Mon, 27 Apr 2009 13:06:57 +0000]
removing sample tests

14 years agotesting changes
Shawn Boyette [Mon, 27 Apr 2009 05:06:58 +0000]
testing changes

14 years agorequired mod looks to be working
Shawn Boyette [Mon, 27 Apr 2009 05:01:16 +0000]
required mod looks to be working

14 years ago1.003 mods now returns *all* mods with no argument
Shawn Boyette [Mon, 27 Apr 2009 04:57:16 +0000]
1.003 mods now returns *all* mods with no argument

14 years agomulti on non-multi mapping error implemented
Shawn Boyette [Mon, 27 Apr 2009 03:29:38 +0000]
multi on non-multi mapping error implemented

14 years agomultiples of non-multi fields is now fatal
Shawn Boyette [Mon, 27 Apr 2009 02:59:23 +0000]
multiples of non-multi fields is now fatal

14 years agosamples working
Shawn Boyette [Sun, 26 Apr 2009 04:52:38 +0000]
samples working

14 years agoexploded marcxml
Shawn Boyette [Sun, 26 Apr 2009 03:44:08 +0000]
exploded marcxml

14 years agonew stuff
Shawn Boyette [Sat, 25 Apr 2009 04:13:11 +0000]
new stuff

14 years agover bump
Shawn Boyette [Sat, 25 Apr 2009 04:12:51 +0000]
ver bump

14 years agoall mapped subfields will now be DEFINED even if their values are NULL
Shawn Boyette [Sat, 25 Apr 2009 04:12:18 +0000]
all mapped subfields will now be DEFINED even if their values are NULL

14 years agotweaks for E::M::SM changes
Shawn Boyette [Fri, 24 Apr 2009 15:29:04 +0000]
tweaks for E::M::SM changes

14 years agomods should return undef when there are no *mods* as well as when there is no mapping...
Shawn Boyette [Fri, 24 Apr 2009 15:28:11 +0000]
mods should return undef when there are no *mods* as well as when there is no mapping *at all*

14 years agofirst tests passing, first records parsed
Shawn Boyette [Fri, 24 Apr 2009 14:52:52 +0000]
first tests passing, first records parsed

14 years agoprotection from overflow
Jason Etheridge [Wed, 22 Apr 2009 23:17:57 +0000]
protection from overflow

15 years agoversion of migration_tools.exec that displays the sql
Jason Etheridge [Mon, 20 Apr 2009 20:34:39 +0000]
version of migration_tools.exec that displays the sql

15 years agoprogress
Shawn Boyette [Mon, 20 Apr 2009 06:35:21 +0000]
progress

15 years agofix for mods being hashref now
Shawn Boyette [Mon, 20 Apr 2009 06:07:57 +0000]
fix for mods being hashref now

15 years agoadding testing files for MDMP
Shawn Boyette [Mon, 20 Apr 2009 06:05:02 +0000]
adding testing files for MDMP

15 years agomods should return a hashref
Shawn Boyette [Mon, 20 Apr 2009 03:48:35 +0000]
mods should return a hashref

15 years agonuking pod tests
Shawn Boyette [Mon, 20 Apr 2009 03:03:57 +0000]
nuking pod tests

15 years agoat least it compiles now, and the docs are mostly in place
Shawn Boyette [Thu, 16 Apr 2009 06:58:27 +0000]
at least it compiles now, and the docs are mostly in place

15 years agomaking this a little more reliable
Shawn Boyette [Wed, 15 Apr 2009 13:54:20 +0000]
making this a little more reliable

15 years agoprint final stats at end of run
Shawn Boyette [Wed, 15 Apr 2009 13:53:42 +0000]
print final stats at end of run

15 years agofixed (i think) trailing </datafield> error in tag stripping
Shawn Boyette [Wed, 15 Apr 2009 04:23:27 +0000]
fixed (i think) trailing </datafield> error in tag stripping
made strip9 the default. removed now-extraneous code

15 years agov1.001 added tags, subfields methods
Shawn Boyette [Tue, 14 Apr 2009 16:00:44 +0000]
v1.001 added tags, subfields methods

15 years agoname change
Shawn Boyette [Mon, 13 Apr 2009 01:16:31 +0000]
name change

15 years agoworking
Shawn Boyette [Mon, 13 Apr 2009 01:15:53 +0000]
working

15 years agomaking reality adn the docs agree
Shawn Boyette [Sun, 12 Apr 2009 02:10:43 +0000]
making reality adn the docs agree

15 years agoimproved trash tag handling by never putting them in the record to begin with (much...
Shawn Boyette [Wed, 8 Apr 2009 04:46:55 +0000]
improved trash tag handling by never putting them in the record to begin with (much less code as well)

15 years agoE::M::SM action
Shawn Boyette [Mon, 6 Apr 2009 13:31:54 +0000]
E::M::SM action

15 years agoquoteds
Shawn Boyette [Mon, 6 Apr 2009 09:52:34 +0000]
quoteds