+
+ - Tangram <-> .csv + - Tangram <-> mysql + - Tangram <-> perl-code+
+
+ - MAPI <-> LDAP + - please visit http://www.netfrag.org/horde/chora/cvs.php/perl/scripts/outlook2ldap/+
+
+ - Tangram <-> mysql+
+
Data::Transfer::Sync is a module providing a generic synchronization process -across arbitrary/multiple storages based on a ident/checksum mechanism. -It sits on top of Data::Storage.
++ Data::Transfer::Sync is a module providing a generic synchronization process + across arbitrary/multiple storages based on a ident/checksum mechanism. + It sits on top of Data::Storage.
+
+ from CPAN or (for win32) a ppm-repository: + App::Config (CPAN only) + Tie::IxHash + Log::Dispatch + Log::Dispatch::Config + mixin + Hash::Merge + Tie::SecureHash + Date::Manip
- For full functionality:
+ from nfo/perl/libs:
+ Data::Compare
Data::Storage
Data::Transform
- Data::Compare
- ... and all their dependencies
+ DesignPattern:: (to be renamed into Class::)
+ ... and all their dependencies.
++
+ Win32::OLE + Net::LDAP+
+
+ DBI + DBD::mysql + DBD::CSV + Tangram
The Data::Storage module is Copyright (c) 2002 Andreas Motl. -All rights reserved.
-You may distribute it under the terms of either the GNU General Public -License or the Artistic License, as specified in the Perl README file.
++ The Data::Transfer::Sync module is Copyright (c) 2002 Andreas Motl. + All rights reserved.+
+ Code contributions, suggestions, support and ideas by + Sebastian Utz <su@tunemedia.de> and Jan Hoffmann <jan@romain-volk.com>. ++
+ + You may distribute it under the terms of either the GNU General Public + License or the Artistic License, as specified in the Perl README file.
Data::Storage is free software. IT COMES WITHOUT WARRANTY OF ANY KIND.
++ Data::Transfer::Sync is free software. IT COMES WITHOUT WARRANTY OF ANY KIND.+
+ Please feel free to contact me at <andreas.motl@ilo.de>.+
+
+
+ notice: PULL INTO backend NODE * TYPE Country SELECT NODE * TYPE [n/a] FROM base USING MODULE BizWorks::ResourceMapping; + notice: OEF::Script::AbstractFeeder: + - Loading data of type [n/a] and + filtered by * from the storage named base + to the storage named backend - filtered by *. + - Will attempt to convert the data to Country. + info: Data::Transfer::Sync::API->syncNodes: source=backend/* [Country] <- target=base/* [] + :c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:ctr:c:ctr:c:c:c:c:c:c:c:c:c:c:c:ctr:c:c:c:ctr:c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c + :c:c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:ctr:c:c:c:c:ctr:c:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:ctr:ctr:c:c:c:c:ctr:c:c:c:c:c:c:c + :c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:ctr:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c + info: Data::Transfer::Sync::Core->_startsync: statistics: in_sync: 180 / total: 197 / attempt_modify: 17 / ok: 17+
+
+ + notice: PULL INTO backend NODE * TYPE Country SELECT NODE * TYPE [n/a] FROM base USING MODULE BizWorks::ResourceMapping; + notice: OEF::Script::AbstractFeeder: + - Loading data of type [n/a] and + filtered by * from the storage named base + to the storage named backend - filtered by *. + - Will attempt to convert the data to Country. + info: Data::Transfer::Sync::API->syncNodes: source=backend/* [Country] <- target=base/* [] + :c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c + :c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c + :c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c + info: Data::Transfer::Sync::Core->_startsync: statistics: in_sync: 197 / total: 197
When in "import" mode for windows file - DBD::AutoCSV may hang. - Hint: Maybe the source node contains an ident-, but no checksum column?+ Hint: Maybe the source node contains an ident-, but no checksum-column?
- - sub _resolveIdentProvider
- - wrap _doModifySource and _doTransferTarget around a core function which can change virtually any type of node
- - split this module up into Sync.pm, Sync/Core.pm, Sync/Compare.pm and Sync/Compare/Checksum.pm
- - introduce _compareNodes as a core method and wrap it around methods in Sync/Compare/Checksum.pm
- - introduce Sync/Compare/MyComparisonImplementation.pm
- - some generic deferring method - e.g. "$self->defer(action)" - to be able to accumulate a bunch of actions for later processing
+ o sub _resolveIdentProvider
+ x wrap _doModifySource and _doTransferTarget around a core function which can change virtually any type of node
+ x split this module up into Sync.pm, Sync/Core.pm, Sync/Compare.pm and Sync/Compare/Checksum.pm
+ o introduce _compareNodes as a core method and wrap it around methods in Sync/Compare/Checksum.pm
+ x introduce Sync/Compare/MyComparisonImplementation.pm
+ o some generic deferring method - e.g. "$self->defer(action)" - to be able to accumulate a bunch of actions for later processing
- this implies everything done is _really_ split up into generic actions - how else would we defer them???
- example uses:
- fetch whole checksum list from node
- remember source ident retransmits
- remember: this is convenient - and maybe / of course faster - but we'll loose "per-node-atomic" operations
- - feature: mechanism to implicit inject checksum property to nodes (alter table / modify schema)
- - expand statistics / keep track of:
+ o feature: mechanism to implicit inject checksum property to nodes (alter table / modify schema)
+ o expand statistics / keep track of:
- touched/untouched nodes
- - full sync
+ o full sync
- just do a push and a pull for now but use stats for touched nodes in between to speed up things
- - introduce some new metadata flags for a synchronization partner which is (e.g.) of "source" or "target":
+ o introduce some new metadata flags for a descent
- isNewNodePropagator
- - isWriteProtected
+ x isWriteProtected