/[cvs]/nfo/perl/libs/Data/Transfer/Sync.pod
ViewVC logotype

Diff of /nfo/perl/libs/Data/Transfer/Sync.pod

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

revision 1.1 by joko, Sun Jan 19 02:03:48 2003 UTC revision 1.2 by joko, Sun Feb 9 04:56:22 2003 UTC
# Line 3  Line 3 
3    
4  =head1 NEWS  =head1 NEWS
5    
 =head4 2003-01-18  -  integration with Torus  
6    
7    please look at http://www.netfrag.org/horde/chora/cvs.php/perl/scripts/outlook2ldap/  =head4 2003-02-09  -  backward compatibility with custom application
8    
9      - Tangram <-> .csv
10      - Tangram <-> mysql
11      - Tangram <-> perl-code
12    
13    
14    =head4 2003-01-18  -  start integration with Torus
15    
16      - MAPI <-> LDAP
17      - please look at http://www.netfrag.org/horde/chora/cvs.php/perl/scripts/outlook2ldap/
18    
19    
20    =head4 2002-10-10  -  initial commit
21    
22      - Tangram <-> mysql
23    
 =head4 2002-10-10  -  initial check-in  
24    
25    
26  =head1 DESCRIPTION  =head1 DESCRIPTION
27    
28  Data::Transfer::Sync is a module providing a generic synchronization process    Data::Transfer::Sync is a module providing a generic synchronization process
29  across arbitrary/multiple storages based on a ident/checksum mechanism.    across arbitrary/multiple storages based on a ident/checksum mechanism.
30  It sits on top of Data::Storage.    It sits on top of Data::Storage.
31    
32    
33    
34  =head1 REQUIREMENTS  =head1 REQUIREMENTS
35    
36    For full functionality:    For full functionality:
37        Data::Compare
38      Data::Storage      Data::Storage
39      Data::Transform      Data::Transform
40      Data::Compare      ... and all their dependencies.
     ... and all their dependencies  
41    
42    
43  =head1 AUTHORS / COPYRIGHT  =head1 AUTHORS / COPYRIGHT / LICENSE
44    
45  The Data::Storage module is Copyright (c) 2002 Andreas Motl.    The Data::Transfer::Sync module is Copyright (c) 2002 Andreas Motl.
46  All rights reserved.    All rights reserved.
47    
48  You may distribute it under the terms of either the GNU General Public    Code contributions, suggestions, support and ideas by
49  License or the Artistic License, as specified in the Perl README file.    Sebastian Utz <su@tunemedia.de> and Jan Hoffmann <jan@romain-volk.com>.
50      
51      You may distribute it under the terms of either the GNU General Public
52      License or the Artistic License, as specified in the Perl README file.
53    
54    
55  =head1 SUPPORT / WARRANTY  =head1 SUPPORT / WARRANTY
56    
57  Data::Storage is free software. IT COMES WITHOUT WARRANTY OF ANY KIND.    Data::Transfer::Sync is free software. IT COMES WITHOUT WARRANTY OF ANY KIND.
58    
59      Please feel free to contact me at <andreas.motl@ilo.de>.
60    
61    
62    
63    =head1 EXAMPLE OUTPUT CHUNKS
64    
65    =head2 Synchronizing orm objects against entries in a .csv file - 17 items modified
66    
67      notice: PULL INTO backend NODE * TYPE Country SELECT NODE * TYPE [n/a] FROM base USING MODULE BizWorks::ResourceMapping;
68      notice: OEF::Script::AbstractFeeder:
69          - Loading data of type [n/a] and
70            filtered by * from the storage named base
71            to the storage named backend - filtered by *.
72          - Will attempt to convert the data to Country.
73      info: Data::Transfer::Sync::API->syncNodes: source=backend/* [Country] <- target=base/* []
74      :c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:ctr:c:ctr:c:c:c:c:c:c:c:c:c:c:c:ctr:c:c:c:ctr:c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c
75      :c:c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:ctr:c:c:c:c:ctr:c:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:ctr:ctr:c:c:c:c:ctr:c:c:c:c:c:c:c
76      :c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:ctr:c:c:ctr:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c
77      info: Data::Transfer::Sync::Core->_startsync: statistics: in_sync: 180  /  total: 197  /  attempt_modify: 17  /  ok: 17
78    
79    =head2 Synchronizing orm objects against entries in a .csv file - in-sync
80      
81      notice: PULL INTO backend NODE * TYPE Country SELECT NODE * TYPE [n/a] FROM base USING MODULE BizWorks::ResourceMapping;
82      notice: OEF::Script::AbstractFeeder:
83          - Loading data of type [n/a] and
84            filtered by * from the storage named base
85            to the storage named backend - filtered by *.
86          - Will attempt to convert the data to Country.
87      info: Data::Transfer::Sync::API->syncNodes: source=backend/* [Country] <- target=base/* []
88      :c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c
89      :c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c
90      :c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c:c
91      info: Data::Transfer::Sync::Core->_startsync: statistics: in_sync: 197  /  total: 197
92    
93    
94    
# Line 125  Data::Storage is free software. IT COMES Line 175  Data::Storage is free software. IT COMES
175    
176  =head1 TODO  =head1 TODO
177    
178    - sub _resolveIdentProvider    o sub _resolveIdentProvider
179    - wrap _doModifySource and _doTransferTarget around a core function which can change virtually any type of node    x wrap _doModifySource and _doTransferTarget around a core function which can change virtually any type of node
180    - split this module up into Sync.pm, Sync/Core.pm, Sync/Compare.pm and Sync/Compare/Checksum.pm    x split this module up into Sync.pm, Sync/Core.pm, Sync/Compare.pm and Sync/Compare/Checksum.pm
181       - introduce _compareNodes as a core method and wrap it around methods in Sync/Compare/Checksum.pm    o introduce _compareNodes as a core method and wrap it around methods in Sync/Compare/Checksum.pm
182    - introduce Sync/Compare/MyComparisonImplementation.pm    x introduce Sync/Compare/MyComparisonImplementation.pm
183    - some generic deferring method - e.g. "$self->defer(action)" - to be able to accumulate a bunch of actions for later processing    o some generic deferring method - e.g. "$self->defer(action)" - to be able to accumulate a bunch of actions for later processing
184       - this implies everything done is _really_ split up into generic actions - how else would we defer them???       - this implies everything done is _really_ split up into generic actions - how else would we defer them???
185       - example uses:       - example uses:
186          - fetch whole checksum list from node          - fetch whole checksum list from node
187          - remember source ident retransmits          - remember source ident retransmits
188       - remember: this is convenient - and maybe / of course faster - but we'll loose "per-node-atomic" operations       - remember: this is convenient - and maybe / of course faster - but we'll loose "per-node-atomic" operations
189    - feature: mechanism to implicit inject checksum property to nodes (alter table / modify schema)    o feature: mechanism to implicit inject checksum property to nodes (alter table / modify schema)
190    - expand statistics / keep track of:    o expand statistics / keep track of:
191      - touched/untouched nodes      - touched/untouched nodes
192    - full sync    o full sync
193      - just do a push and a pull for now but use stats for touched nodes in between to speed up things      - just do a push and a pull for now but use stats for touched nodes in between to speed up things
194    - introduce some new metadata flags for a synchronization partner which is (e.g.) of "source" or "target":    o introduce some new metadata flags for a descent
195      - isNewNodePropagator      - isNewNodePropagator
196      - isWriteProtected      x isWriteProtected
197    
198    
199  =cut  =cut
Legend:
Removed from v.1.1  
changed lines
  Added in v.1.2
MailToCvsAdmin">MailToCvsAdmin
 ViewVC Help
Powered by ViewVC 1.1.26 RSS 2.0 feed