migration-tools.git
13 years agomove dynamic item mapping functionality to base.sql; it's not ILS specific
Jason Etheridge [Wed, 12 Aug 2009 04:58:48 +0000]
move dynamic item mapping functionality to base.sql; it's not ILS specific

13 years agothis stored procedure is a true function with no side effects
Jason Etheridge [Tue, 11 Aug 2009 10:39:15 +0000]
this stored procedure is a true function with no side effects

13 years agoname parser
Jason Etheridge [Tue, 11 Aug 2009 10:37:09 +0000]
name parser

13 years agofix signature
Jason Etheridge [Sat, 8 Aug 2009 22:52:13 +0000]
fix signature

13 years agostart moving this mapping functionality over to base, since the only part that is...
Jason Etheridge [Sat, 8 Aug 2009 22:41:00 +0000]
start moving this mapping functionality over to base, since the only part that is ILS specific is the data that drives it

13 years agoMDMP require version bumped
Shawn Boyette [Mon, 27 Jul 2009 16:06:22 +0000]
MDMP require version bumped
believe non-holding multis work now
null non-holdings data handled better

13 years ago1.005
Shawn Boyette [Mon, 27 Jul 2009 16:06:21 +0000]
1.005
added 'ignoremulti' modifier
mods handling slightly tweaked

13 years agonewline at end of sample run
Shawn Boyette [Tue, 14 Jul 2009 03:07:46 +0000]
newline at end of sample run

13 years ago--marcfile no longer gets -m; --map does
Shawn Boyette [Mon, 13 Jul 2009 18:14:12 +0000]
--marcfile no longer gets -m; --map does

13 years agoautoset marcfile on prefix
Shawn Boyette [Thu, 9 Jul 2009 16:29:41 +0000]
autoset marcfile on prefix

13 years agooopses
Shawn Boyette [Thu, 9 Jul 2009 14:24:34 +0000]
oopses

13 years agoredo
Shawn Boyette [Thu, 9 Jul 2009 14:09:18 +0000]
redo

13 years agoredoing previous changes
Shawn Boyette [Thu, 9 Jul 2009 14:09:17 +0000]
redoing previous changes

13 years agorescued changes
Shawn Boyette [Thu, 9 Jul 2009 13:56:41 +0000]
rescued changes

13 years agoyanking DBM::Deep stuffs
Shawn Boyette [Thu, 25 Jun 2009 17:31:51 +0000]
yanking DBM::Deep stuffs

13 years agoremoving DBMD, phase I
Shawn Boyette [Thu, 25 Jun 2009 17:31:50 +0000]
removing DBMD, phase I

13 years agoold2new generation now handles controlfields and will map any number of matches,...
Shawn Boyette [Wed, 24 Jun 2009 19:20:19 +0000]
old2new generation now handles controlfields and will map any number of matches, not just one-per-record

13 years agotweaks
Shawn Boyette [Wed, 24 Jun 2009 19:20:19 +0000]
tweaks

13 years agotypo fix
Shawn Boyette [Wed, 24 Jun 2009 19:20:19 +0000]
typo fix

13 years agoimproved multifile handling
Shawn Boyette [Wed, 24 Jun 2009 19:20:18 +0000]
improved multifile handling

13 years agomulti extractions work now. holding seq# always included now
Shawn Boyette [Wed, 24 Jun 2009 19:20:18 +0000]
multi extractions work now. holding seq# always included now

13 years agomaking sampling work better
Shawn Boyette [Wed, 24 Jun 2009 19:20:17 +0000]
making sampling work better

13 years agoadded subs thresholding
Shawn Boyette [Wed, 24 Jun 2009 19:20:17 +0000]
added subs thresholding

13 years agoversion bump
Shawn Boyette [Wed, 24 Jun 2009 19:20:16 +0000]
version bump

13 years agofixes for multi subfields
Shawn Boyette [Wed, 24 Jun 2009 19:20:16 +0000]
fixes for multi subfields
added get_multis method

13 years agoautoflush turned off for DBM::Deep
Shawn Boyette [Wed, 24 Jun 2009 19:20:15 +0000]
autoflush turned off for DBM::Deep
name method doesn't require rec# anymore
{names} gone from record dataset

13 years agotest for existing DBMD file; die
Shawn Boyette [Thu, 18 Jun 2009 18:23:37 +0000]
test for existing DBMD file; die

13 years agoset default window size to 9 lines
Shawn Boyette [Thu, 18 Jun 2009 18:23:36 +0000]
set default window size to 9 lines

13 years agoholdings dump status msg now counts holdings instead of records
Shawn Boyette [Thu, 18 Jun 2009 18:23:35 +0000]
holdings dump status msg now counts holdings instead of records

13 years agoworks with new MDMP
Shawn Boyette [Fri, 12 Jun 2009 18:30:37 +0000]
works with new MDMP

13 years agotake rcnt out of dstore and call it reccount
Shawn Boyette [Fri, 12 Jun 2009 18:30:36 +0000]
take rcnt out of dstore and call it reccount

13 years agochanged rptr to rcnt
Shawn Boyette [Fri, 12 Jun 2009 18:30:36 +0000]
changed rptr to rcnt

13 years agoargs handling bug
Shawn Boyette [Fri, 12 Jun 2009 18:30:36 +0000]
args handling bug

13 years agoKeeping MDMP from eating all teh rams (WIP)
Shawn Boyette [Fri, 12 Jun 2009 18:30:35 +0000]
Keeping MDMP from eating all teh rams (WIP)

13 years agoscope tweaking
Shawn Boyette [Fri, 12 Jun 2009 18:30:34 +0000]
scope tweaking

13 years ago1.003 No longer purely OO, to allow XML::Twig to run in handler mode (cuts memory...
Shawn Boyette [Fri, 12 Jun 2009 18:30:34 +0000]
1.003 No longer purely OO, to allow XML::Twig to run in handler mode (cuts memory usage from 2G+ to ~25M for full sampling

13 years agotest fixes for 1.003
Shawn Boyette [Fri, 12 Jun 2009 18:30:33 +0000]
test fixes for 1.003

13 years agochangelog
Shawn Boyette [Wed, 10 Jun 2009 16:54:28 +0000]
changelog

13 years ago1.002 if any instance of a sub has a value, that should now appear in detail sample...
Shawn Boyette [Wed, 10 Jun 2009 16:54:27 +0000]
1.002 if any instance of a sub has a value, that should now appear in detail sample output

13 years agosubfield report added to detail
Shawn Boyette [Fri, 29 May 2009 21:14:33 +0000]
subfield report added to detail

13 years agosbufield lengthtracking implemented
Shawn Boyette [Fri, 29 May 2009 21:14:32 +0000]
sbufield lengthtracking implemented

13 years ago1.001 changed sample detail format to one which can be dumped directly into a dokuwik...
Shawn Boyette [Wed, 27 May 2009 17:01:29 +0000]
1.001 changed sample detail format to one which can be dumped directly into a dokuwiki page

13 years agomulti hash now uses just code for key
Shawn Boyette [Wed, 27 May 2009 15:35:12 +0000]
multi hash now uses just code for key

13 years agocruddy temporary fix while multi is sorted out
Shawn Boyette [Wed, 27 May 2009 15:35:11 +0000]
cruddy temporary fix while multi is sorted out

13 years agotrying to fix memory problems, but barkingup wrong tree
Shawn Boyette [Fri, 22 May 2009 14:47:20 +0000]
trying to fix memory problems, but barkingup wrong tree

13 years agoSTL now prints file name on fail open
Shawn Boyette [Fri, 22 May 2009 14:47:20 +0000]
STL now prints file name on fail open

13 years agothis is actually bearable with \set verbosity terse
Jason Etheridge [Wed, 20 May 2009 03:35:33 +0000]
this is actually bearable with \set verbosity terse

13 years agoimproved error reporting
Shawn Boyette [Wed, 13 May 2009 14:48:49 +0000]
improved error reporting

13 years agofix for undef value in regex
Shawn Boyette [Wed, 13 May 2009 14:48:48 +0000]
fix for undef value in regex

13 years agocleanup before new work
Shawn Boyette [Thu, 7 May 2009 16:17:51 +0000]
cleanup before new work

13 years agofixes
Shawn Boyette [Wed, 6 May 2009 20:59:12 +0000]
fixes

13 years agoworks (pretty much)
Shawn Boyette [Wed, 6 May 2009 20:58:45 +0000]
works (pretty much)

13 years agotmap updates
Shawn Boyette [Tue, 5 May 2009 20:27:38 +0000]
tmap updates

13 years agosample stuffs working pretty good now
Shawn Boyette [Tue, 5 May 2009 16:43:45 +0000]
sample stuffs working pretty good now

13 years agofixes to tag counts
Shawn Boyette [Tue, 5 May 2009 16:32:18 +0000]
fixes to tag counts

13 years agomisc
Shawn Boyette [Tue, 5 May 2009 15:12:05 +0000]
misc

13 years agosample routines basically working
Shawn Boyette [Tue, 5 May 2009 15:00:01 +0000]
sample routines basically working

13 years agofergot semicolon derrrrr
Shawn Boyette [Thu, 30 Apr 2009 14:33:52 +0000]
fergot semicolon derrrrr

13 years agodoc updates
Shawn Boyette [Thu, 30 Apr 2009 14:33:08 +0000]
doc updates

13 years agofilters in MDMP
Shawn Boyette [Thu, 30 Apr 2009 01:49:35 +0000]
filters in MDMP

13 years agosingle-chunk tokens being quoted is ok now. misc other fixes
Shawn Boyette [Thu, 30 Apr 2009 01:33:00 +0000]
single-chunk tokens being quoted is ok now. misc other fixes

13 years agoinitial checkin
Shawn Boyette [Wed, 29 Apr 2009 23:43:01 +0000]
initial checkin

13 years agoyanking bib references; adding tag map to MDMP; cleanup and new test corpus data
Shawn Boyette [Wed, 29 Apr 2009 20:01:38 +0000]
yanking bib references; adding tag map to MDMP; cleanup and new test corpus data

13 years agowhen looking for date in 260$c, non-numerics are now removed to improve quality of...
Shawn Boyette [Wed, 29 Apr 2009 15:51:26 +0000]
when looking for date in 260$c, non-numerics are now removed to improve quality of data

13 years agoadding marcxml namespace to the wrapping collection element
Mike Rylander [Wed, 29 Apr 2009 15:22:08 +0000]
adding marcxml namespace to the wrapping collection element

13 years agobirthing MARCXMLSampler
Shawn Boyette [Tue, 28 Apr 2009 02:31:51 +0000]
birthing MARCXMLSampler

13 years ago1.001 generate now takes 2 arguments: a filename or string, and any true value if...
Shawn Boyette [Mon, 27 Apr 2009 19:21:56 +0000]
1.001 generate now takes 2 arguments: a filename or string, and any true value if the first argument is a string, to indicate that fact

13 years agoremoving sample tests
Shawn Boyette [Mon, 27 Apr 2009 13:06:57 +0000]
removing sample tests

13 years agotesting changes
Shawn Boyette [Mon, 27 Apr 2009 05:06:58 +0000]
testing changes

13 years agorequired mod looks to be working
Shawn Boyette [Mon, 27 Apr 2009 05:01:16 +0000]
required mod looks to be working

13 years ago1.003 mods now returns *all* mods with no argument
Shawn Boyette [Mon, 27 Apr 2009 04:57:16 +0000]
1.003 mods now returns *all* mods with no argument

13 years agomulti on non-multi mapping error implemented
Shawn Boyette [Mon, 27 Apr 2009 03:29:38 +0000]
multi on non-multi mapping error implemented

13 years agomultiples of non-multi fields is now fatal
Shawn Boyette [Mon, 27 Apr 2009 02:59:23 +0000]
multiples of non-multi fields is now fatal

13 years agosamples working
Shawn Boyette [Sun, 26 Apr 2009 04:52:38 +0000]
samples working

13 years agoexploded marcxml
Shawn Boyette [Sun, 26 Apr 2009 03:44:08 +0000]
exploded marcxml

13 years agonew stuff
Shawn Boyette [Sat, 25 Apr 2009 04:13:11 +0000]
new stuff

13 years agover bump
Shawn Boyette [Sat, 25 Apr 2009 04:12:51 +0000]
ver bump

13 years agoall mapped subfields will now be DEFINED even if their values are NULL
Shawn Boyette [Sat, 25 Apr 2009 04:12:18 +0000]
all mapped subfields will now be DEFINED even if their values are NULL

13 years agotweaks for E::M::SM changes
Shawn Boyette [Fri, 24 Apr 2009 15:29:04 +0000]
tweaks for E::M::SM changes

13 years agomods should return undef when there are no *mods* as well as when there is no mapping...
Shawn Boyette [Fri, 24 Apr 2009 15:28:11 +0000]
mods should return undef when there are no *mods* as well as when there is no mapping *at all*

13 years agofirst tests passing, first records parsed
Shawn Boyette [Fri, 24 Apr 2009 14:52:52 +0000]
first tests passing, first records parsed

13 years agoprotection from overflow
Jason Etheridge [Wed, 22 Apr 2009 23:17:57 +0000]
protection from overflow

13 years agoversion of migration_tools.exec that displays the sql
Jason Etheridge [Mon, 20 Apr 2009 20:34:39 +0000]
version of migration_tools.exec that displays the sql

13 years agoprogress
Shawn Boyette [Mon, 20 Apr 2009 06:35:21 +0000]
progress

13 years agofix for mods being hashref now
Shawn Boyette [Mon, 20 Apr 2009 06:07:57 +0000]
fix for mods being hashref now

13 years agoadding testing files for MDMP
Shawn Boyette [Mon, 20 Apr 2009 06:05:02 +0000]
adding testing files for MDMP

13 years agomods should return a hashref
Shawn Boyette [Mon, 20 Apr 2009 03:48:35 +0000]
mods should return a hashref

13 years agonuking pod tests
Shawn Boyette [Mon, 20 Apr 2009 03:03:57 +0000]
nuking pod tests

13 years agoat least it compiles now, and the docs are mostly in place
Shawn Boyette [Thu, 16 Apr 2009 06:58:27 +0000]
at least it compiles now, and the docs are mostly in place

13 years agomaking this a little more reliable
Shawn Boyette [Wed, 15 Apr 2009 13:54:20 +0000]
making this a little more reliable

13 years agoprint final stats at end of run
Shawn Boyette [Wed, 15 Apr 2009 13:53:42 +0000]
print final stats at end of run

13 years agofixed (i think) trailing </datafield> error in tag stripping
Shawn Boyette [Wed, 15 Apr 2009 04:23:27 +0000]
fixed (i think) trailing </datafield> error in tag stripping
made strip9 the default. removed now-extraneous code

13 years agov1.001 added tags, subfields methods
Shawn Boyette [Tue, 14 Apr 2009 16:00:44 +0000]
v1.001 added tags, subfields methods

13 years agoname change
Shawn Boyette [Mon, 13 Apr 2009 01:16:31 +0000]
name change

13 years agoworking
Shawn Boyette [Mon, 13 Apr 2009 01:15:53 +0000]
working

13 years agomaking reality adn the docs agree
Shawn Boyette [Sun, 12 Apr 2009 02:10:43 +0000]
making reality adn the docs agree

13 years agoimproved trash tag handling by never putting them in the record to begin with (much...
Shawn Boyette [Wed, 8 Apr 2009 04:46:55 +0000]
improved trash tag handling by never putting them in the record to begin with (much less code as well)

13 years agoE::M::SM action
Shawn Boyette [Mon, 6 Apr 2009 13:31:54 +0000]
E::M::SM action

13 years agoquoteds
Shawn Boyette [Mon, 6 Apr 2009 09:52:34 +0000]
quoteds

13 years agoforgot quoted values
Shawn Boyette [Mon, 6 Apr 2009 09:51:33 +0000]
forgot quoted values