doc/SampleTasks/joko_2003-03.twingle

@sequence meta
@title joko's sample notes - 2003-03 - ResourceIntegration
@subtitle ResourceIntegration II
@topic joko's Tasks
@author joko@netfrag.org
@document-mime-type text/plain
@document-mime-type text/english text/german
@document-mime-type text/vnd.twingle

@sequence meta
@document-history
@cvs-info
  $Id: joko_2003-03.twingle,v 1.60 2003/03/12 15:55:57 joko Exp $
  $Log: joko_2003-03.twingle,v $
  Revision 1.60  2003/03/12 15:55:57  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.59  2003/03/12 05:56:09  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.58  2003/03/12 05:26:22  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.57  2003/03/12 04:55:52  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.56  2003/03/12 04:26:09  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.55  2003/03/12 02:55:54  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.54  2003/03/12 01:55:58  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.53  2003/03/12 01:25:57  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.52  2003/03/11 23:55:58  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.51  2003/03/11 23:25:49  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.50  2003/03/11 22:56:12  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.48  2003/03/11 22:03:23  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.47  2003/03/11 21:05:22  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.45  2003/03/11 18:55:52  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.43  2003/03/11 17:56:02  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.42  2003/03/11 15:26:01  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.41  2003/03/11 14:56:02  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.40  2003/03/11 06:25:59  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.39  2003/03/11 05:56:44  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.38  2003/03/11 05:26:23  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.37  2003/03/11 04:25:58  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.36  2003/03/11 02:55:54  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.35  2003/03/11 01:55:57  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.34  2003/03/10 23:55:51  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.33  2003/03/10 18:55:55  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.32  2003/03/10 17:56:05  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.31  2003/03/10 16:25:55  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.30  2003/03/10 03:56:32  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.29  2003/03/10 03:27:24  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.27  2003/03/09 19:56:04  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.25  2003/03/08 23:26:21  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.24  2003/03/08 22:56:30  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.23  2003/03/08 18:26:20  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.21  2003/03/08 14:26:13  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.20  2003/03/08 13:56:42  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.19  2003/03/08 12:56:24  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.18  2003/03/08 12:27:20  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.17  2003/03/08 11:27:00  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.16  2003/03/08 08:56:05  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.15  2003/03/08 07:55:59  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.14  2003/03/08 07:25:57  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.13  2003/03/08 05:56:38  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.12  2003/03/08 05:25:54  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.11  2003/03/08 04:55:46  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.10  2003/03/07 22:26:20  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.9  2003/03/07 20:56:02  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.8  2003/03/07 18:26:17  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.7  2003/03/07 17:56:46  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.6  2003/03/07 16:56:42  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.5  2003/03/07 15:57:11  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.4  2003/03/07 04:25:54  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.3  2003/03/07 03:56:59  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.2  2003/03/07 00:56:08  joko
  + AUTOCOMMIT: updated/added content

  Revision 1.1  2003/03/06 22:34:20  joko
  + initial commit


@sequence meta
@x-transport
@x-transport-from grasshopper.netfrag.org
@x-transport-to quepasa.netfrag.org
@x-transporter Microsoft Windows
@x-transporter WinCVS [WinCVS 1.3.8.1 Beta 8 (Build 1)]
@x-transporter-protocol cvs client-server protocol
@x-transporter OpenSSH client on grasshopper [OpenSSH_3.4p1, SSH protocols 1.5/2.0, OpenSSL 0x0090607f]
@x-transporter-protocol ssh [OpenSSH Version 2]
@x-transporter OpenSSH daemon on quepasa [OpenSSH_3.4p1 Debian 1:3.4p1-1, SSH protocols 1.5/2.0, OpenSSL 0x0090603f]
@x-transporter cvs [Concurrent Versions System (CVS) 1.11.1p1 (client/server)]
@x-transporter-protocol cvs client-server protocol
@x-transporter Linux running on quepasa.netfrag.org [Linux version 2.4.18-29um (root@linux) (gcc version 2.95.3 20010315 (SuSE)) #1 Sun May 26 17:01:48 CEST 2002]
@x-transporter-protocol ext3
@x-transporter Linux running on h1.service.netfrag.org [Linux version 2.4.10-4GB (root@Pentium.suse.de) (gcc version 2.95.3 20010315 (SuSE)) #1 Tue Sep 25 12:33:54 GMT 2001]
@x-transporter-protocol ext3
#@x-converter twingle [Twingle 0.01 - http://search.netfrag.org/twingle]

@sequence script
@set o=@todo


@sequence block
@injected
@date 2003-03-06 20:29
@file [unknown]
@x-editor Notepad [Microsoft Editor Version 5.0 (Build 2195: Service Pack 3)
@x-transporter Microsoft COM
@x-transporter-protocol copy & paste negotiation
@x-editor UltraEdit [UltraEdit(r)-32 Professional Text/HEX Editor Version 8.10b]


o use arial|verdana for netscape|mozilla rendering on netfrag.org

- We get spam!
  After feeling relatively safe through amavis based email filtering, it happened again.
  jonen recieved some spam again.
  
  Why?
  I believe the addresses get collected by foreign agents crawling
  the growing content on netfrag.org.
  
  What todo now?
  Mungle email addresses published on netfrag.org through some lisp-
  or scheme-based address-mungler found recently.
  They stay rfc-compliant, but are (hopefully) unreachable for common
  regex parsers.
  Send info to ->jonen.
  @tbd Automate this task! Do you wanna rewrite each address by hand...???

o personal requirement:
  o daily: review contributions made by other users
  o requirement to solve this: have everything as rss/rdf and filter the xml by author

o rss.netfrag.org (register)
  o establish some web-based rss-browser embedding content from
    o RssGenerators for local content ...
      o news//rss (for news.netfrag.org)
      o cvs//rss (for cvs.netfrag.org)
    o ... and RssGateways to other ones, possibly at remote locations
      o phpWiki//rss (for www.netfrag.org)
      o TWiki//rss (for future www.netfrag.org)

o post to perl-development (nfo.dev.perl):
  o how to abstract the view/editing of xml-files via an api?
    o fetch: all|single-node
    o edit: single-node flattened into an object
  o browser layer: locator registry (pointing to a) an orm-db and b) to a file-set of xml-files (our control-db))
  o item layer: view/edit nodes of an xml-file a) in a tree-editor (look at HTML_Tree_XYZ itself!!!) and 
     b) split into our "flat-components" Item and List (object-like)

      how b)? solve in backend!
      o backend
        o change values containing references to their interpolated placeholders to convert a node to an item
           ->getNode(...)
           example: getNode('root')
        o place querying api via XPath parallel to that -> also returns a single node or multiples (a node-set)
           ->getNodeSet(...)
           example: getNodeSet('xpath-query|named-filter')
        o establish backend querying api for xml-documents on top of that!
           ->sendQuery(...) should dispatch to one of ->getNode or ->getNodeSet
      o frontend
        o browse relations (parent-, child-node) using the ValueInterpolator and the ItemComponent
        o edit Attributes and Content of Nodes with the ItemComponent showing *two* areas (this is the "FlatteningOfNodes"):
          o -> attributes
          o -> content
          That's the way various XML-EasyTree-Xyz implementations use to work.
          @link http://www.cpan.org/
        o frontend issues these generic rpc-commands to the backend (encapsulated somewhere)
          o ->sendQuery(array(remote=1, rpc=1, blah=1,   $query      )) - 
          which gets dispatched by switching some stuff from "$query" to these methods under the hood (in fact, *implemented at backend side*)
            o ->getNodeSet('xpath-query|named-filter')
          example: 
            $xml_filter_query = array( 'return' => 'object|object-set', [filter => 'xpath-query|named-filter'] );
                            (speak: Item or List)
            sendQuery(array(remote=1, rpc=1, blah=1,  $xml_filter_query , xml=1???   )) - 

  --> what is 'remote' and/or 'rpc' about???
  if i remember that right - 'remote' means 'orm' (the datasource-type) and 'rpc' means 'rpc' (the transport-type)

o new twingle-symbol-topology using ...
  <code>
  o ... @-tags (stolen from JavaDoc via phpDocumentor)
  o @-tags only refer to scopes they live in
  o make the basic work: @todo, @link, @see, etc.  (but enhanced - of course - since perl doesn't limit you in any way....!!!)
  o add some more: @sequence, @is-a, @title
  o @see
    o @embed this-and-that from these .twingle files:
      o @link DummyNamespaces in PHP - final proposal.twingle
      o @link Re - Namespaces in PHP.twingle
  </code>

o project-metadata: / nfo topics
  <code>
  @is-a rfc
  @todo tbd
  x @topic source(cvs)
  x @topic doc(api)
  o @topic source(raw)  (via symlinks: expand directories first, symlink files afterwards!)
  o @topic doc(tutorial)
  o @topic doc(examples)
  o @topic doc(howto)
  o introduce: @subtopic:
    @topic source
      @subtopic raw|cvs
    @topic doc
      @subtopic api|tutorial|examples|howto
  </code>

o register: api.netfrag.org

o arcor!!!

o working alpha version of "Ts" on new server niu!!!

o .phpdocrc: split main code to module, integrate index-generation of predefined (registered) modules

o RssNewsletter:
  o schedule
     o hourly, daily, weekly, monthly, on-incoming
  o choose topic
     o all topics (cvs, news, api, docs, www)
  o choose destination
     o filtered-rss made available at specified url as xml or xhtml
     o via email
     o archived in archive-type (zip|tar) with format (html|) 
        made available at specified url

o look at FreeBSD's "doscmd"!!!

o mechanism to refactor old smtp-mail-messages into new nntp-news-posts
  all our tools fail! *forwarding* the message seems to break mime (for e.g. the mozilla-viewer and probably others)
  o possible solution: strip "--- forwarded by ---" - header before actually posting
    maybe identifiable by subject: [Fwd: ]

o enhance Twingle:
  o twingle2message:
    o twingle2mail: twingle2rfc822, twingle2mime
    o twingle2news: twingle2rfc

o gather version info from installed components: 
  o CPAN
  o PEAR
  x GNU: <program> --version   (e.g.: cvs --version)
  x OpenSSH: ssh -V
  x Linux: cat /proc/version
  o our Perl-/PHP- component system


@sequence block
@written
@date 2003-03-06
@x-editor UltraEdit [UltraEdit(r)-32 Professional Text/HEX Editor Version 8.10b]

o what are the MIME-types of XML-payloads sent between (e.g.) RPCXML-hosts???
  text/xml???

  look at /etc/mime.types!!!
  e.g.: (stripped from there) - looking interesting:
    
    text/*
    text/x-java
    text/uri-list
    text/rfc822-headers
    text/directory
    text/vnd.IPTC.NewsML
    text/vnd.IPTC.NITF
    text/vnd.motorola.reflex
    text/vnd.DMClientScript
    text/richtext
    text/rtf
    text/plain
    text/comma-seperated-values
    text/css
    text/enriched
    
    --> vnd=vendor???
    
    @sequence references
    @title The text/enriched MIME Content-type
    @link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1896.html
      @title Mechanisms for Specifying and Describing the Format of Internet Message Bodies
      @link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1521.html
      @title The text/enriched MIME Content-type
      @link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1523.html
        @title Mechanisms for Specifying and Describing the Format of Internet Message Bodies
        @link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1341.html
      @title The text/enriched MIME Content-type
      @link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1563.html
    
    message/delivery-status
    message/disposition-notification
    message/external-body
    message/http
    message/s-http
    message/news
    message/partial
    message/rfc822

    inode/chardevice
    inode/blockdevice
    inode/directory-locked
    inode/directory
    inode/fifo
    inode/socket

    multipart/*
    
o refactor some twingle tags using ETF:
  @link http://citeseer.nj.nec.com/borenstein94textenriched.html
  --- snip ---
  @misc{ borenstein-textenriched,
    author = "N. Borenstein",
    title = "The text/enriched MIME Content-type",
    url = "citeseer.nj.nec.com/borenstein94textenriched.html" }
  --- snip ---

o re-enable yakka!
  @link http://netfrag.org/~bareface/yakka/
  
o search.netfrag.org
  o enable mnoGoSearch to index http://www.netfrag.org/docs/code/api/

o post xml-via-rpc-querying proposal from above to nfo.dev.perl and cc to jonen!

o enhancement for Twingle AutoLink LinkInterpolation:
  o don't resolve namespace identifiers (e.g. 'Data::Storage') against
     global search.netfrag.org/Search::This::Namespace
  o query namespaced links against an organization-wide (custom) NamespaceRegistry before!!!
    o use mysql/Tangram?
    o use xml?
  o just fallback to "GlobalSerchMode" if nothing was found in the step before!
  o Data::Storage will directly be resolved to this url or tag afterwards:
     @link http://www.netfrag.org/docs/topics/perl-libs/Data-Storage.html
     and not to
     @link http://www.netfrag.org/search/?q=Data::Storage&o=1&ul=/
     like it was before!

o mimic the functionality of TLTP (The LDAP Trigger Process) by using Data::Rap.

o applications to be solved using LDAP
  o organization-wide addressbook
  o global / per-app software component registry
  o organization-wide item library -> inventory
  
dot http://www.nc.ihost.com/ -> IBM

@topic EasyAuthoring
@see sdf
@see text/enriched
@see ETF
@see WPP
@link http://the.sunnyspot.org/wpp/index.html

@company Watchfire
@topic centrally located site integrity management software
@link http://www.watchfire.com/

o look at brian finley's "Storage" article series at http://hpc.devchannel.org/ !!!

- f-prot error on quepasa.netfrag.org:
  root@quepasa:~# tail -f /var/log/mail.log
  --- snip ---
  Mar  7 18:23:30 quepasa amavis[20705]: Virus scanner failure: /usr/local/f-prot/f-prot (error code: 1)
  Mar  7 18:23:30 quepasa amavis[20705]: virus_scan FAILED, retry: All virus scanners failed! at /usr/sbin/amavisd line 933, <GEN9> line 4712.
  Mar  7 18:23:30 quepasa amavis[20705]: mail processing failed, RETRY/TEMPFAIL
  Mar  7 18:23:30 quepasa sm-mta[20758]: h27HLveE020758: Milter: data, reject=451 4.7.1 Please try again later
  --- snip ---
  root@quepasa:~# /usr/local/f-prot/f-prot
  Error: SIGN.DEF is damaged or incompatible with this version of F-PROT.
  root@quepasa:~# /usr/local/f-prot/check-updates.sh
  root@quepasa:~# /usr/local/f-prot/f-prot


@sequence block
@injected
@date 2003-03-07 19:01
@file [unknown]
@x-editor Notepad [Microsoft Editor Version 5.0 (Build 2195: Service Pack 3)
@x-transporter Microsoft COM
@x-transporter-protocol copy & paste negotiation
@x-editor UltraEdit [UltraEdit(r)-32 Professional Text/HEX Editor Version 8.10b]

@set ->=@see


o .phpdocrc: Tie::IxHash

- writing a browser is a complex task
  -> Internet Explorer
  -> KDE xyz
  -> Mozilla

- writing a mailer is a complex task
  -> Microsoft Outlook and (-Express)
  -> KDE (KMail, Kontact, Kolab)
  -> Evolution
  -> Mahogany


@sequence block
@written
@date 2003-03-07

- janosch: pdf-gateway!?

o setup ->colorize on quepasa.netfrag.org

o refactor DesignPattern::MVC
  o new: @uses instances of classes inherited from the base ones 
     DesignPattern::MVC::Model and DesignPattern::MVC::View, where
       - DesignPattern::MVC::Model is-a DesignPattern::Observer::Subject
       - DesignPattern::MVC::View is-a DesignPattern::Observer
  o new: refactor the rules-subsystem to be a ChangeManager
     between Subject and Observer sits a ChangeManager acting as mediator (is-a DesignPattern::Mediator)
     @see http://selab.korea.ac.kr/selab/courses/GoF-patterns/observer.htm

o Twingle!
  o twingle -> dispatchmail (Twingle::Mail)
  o twingle -> twingledoc (Twingle::Doc)

o refactor to "twingled/":
  o http://netfrag.org/~joko/computing/overview/topics/topics/
  o http://netfrag.org/~joko/computing/overview/topics/SampleTasks/
o update http://netfrag.org/~joko/computing/overview/topics/topics.html

x re-enable Yakka

o setup phpDocumentor from cvs

o "subscribe" a Folder (using rss/rdf!)

o Arial (or similar font w/o serifs) for Mozilla!

o edit preferences: Font (family, size)

o debian-upgrade -> perl-upgrade => missing CPAN packages =>
  o check in intervals:
    o /data/opt/dispatchmail/bin/dispatchmail
      --- snip ---  [/var/log/mail.log]
      Mar  8 07:15:51 quepasa sm-mta[30731]: h286FmeE030726: to=|"/data/opt/dispatchmail/bin/dispatchmail --base=/home/joko/virtual/joko_mail", ctladdr=<joko_mail@quepasa.netfrag.org> (1000/100), delay=00:00:03, xdelay=00:00:01, mailer=prog, pri=30962, dsn=5.3.0, stat=unknown mailer error 2
      Mar  8 07:15:51 quepasa sm-mta[30731]: h286FmeE030726: h286FpeD030731: DSN: unknown mailer error 2
      Mar  8 07:15:52 quepasa sm-mta[30731]: h286FpeD030731: to=|"/data/opt/dispatchmail/bin/dispatchmail --base=/home/joko/virtual/joko_mail", ctladdr=<joko_mail@quepasa.netfrag.org> (1000/100), delay=00:00:01, xdelay=00:00:01, mailer=prog, pri=31986, dsn=5.3.0, stat=unknown mailer error 2
      Mar  8 07:15:52 quepasa sm-mta[30731]: h286FpeD030731: h286FpeE030731: return to sender: unknown mailer error 2
      Mar  8 07:15:53 quepasa sm-mta[30731]: h286FpeE030731: to=|"/data/opt/dispatchmail/bin/dispatchmail --base=/home/joko/virtual/joko_mail", ctladdr=joko_mail (1000/100), delay=00:00:01, xdelay=00:00:01, mailer=prog, pri=33010, dsn=5.3.0, stat=unknown mailer error 2
      Mar  8 07:15:53 quepasa sm-mta[30731]: h286FpeD030731: Saved message in /var/lib/sendmail/dead.letter
      --- snip ---
      Can't locate Hash/Merge.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl .) at ./dispatchmail line 34.
      BEGIN failed--compilation aborted at ./dispatchmail line 34.
      x perl -MCPAN -e "install Hash::Merge"
        dependencies resolved automagically: ->Clone
    o /data/opt/dispatchmail/bin/postmessage
      --- snip ---  [/var/log/mail.log]
      Mar  8 07:26:40 quepasa sm-mta[30953]: h286Q5eE030946: to=|/data/opt/dispatchmail/bin/dispatchmail, ctladdr=<links-computing@netfrag.org> (1014/1014), delay=00:00:32, xdelay=00:00:22, mailer=prog, pri=47232, dsn=5.3.0, stat=unknown mailer error 2
      Mar  8 07:26:41 quepasa sm-mta[30953]: h286Q5eE030946: h286QfeD030953: DSN: unknown mailer error 2
      Mar  8 07:26:47 quepasa sm-mta[30946]: h286Q5eG030946: collect: premature EOM: unexpected close
      Mar  8 07:26:47 quepasa sm-mta[30946]: h286Q5eG030946: collect: unexpected close on connection from pD9E77CD4.dip.t-dialin.net, sender=<andreas.motl@ilo.de>
      --- snip ---
      Can't locate News/Article.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl .) at ./postmessage line 8.
      BEGIN failed--compilation aborted at ./postmessage line 8.
      x perl -MCPAN -e "install News::Article"
    o /data/opt/dispatchmail/bin/buildmail
      Can't locate MIME/Lite.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl .) at ./buildmail line 7.
      BEGIN failed--compilation aborted at ./buildmail line 7.
      x perl -MCPAN -e "install MIME::Lite"
    o /data/opt/dispatchmail/bin-tests/build_dispatch_mode mail2news alt.test
      DesignPattern::Bridge->load: Can't locate mixin/with.pm in @INC (@INC contains: /data/libs/nfo/perl/libs /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl .) at /data/libs/nfo/perl/libs/Mail/Audit/Dispatch/Newsgate.pm line 6, <STDIN> line 16.
      BEGIN failed--compilation aborted at /data/libs/nfo/perl/libs/Mail/Audit/Dispatch/Newsgate.pm line 6, <STDIN> line 16.
      Compilation failed in require at (eval 6) line 1, <STDIN> line 16.
      BEGIN failed--compilation aborted at (eval 6) line 1, <STDIN> line 16.
       (/data/libs/nfo/perl/libs/Mail/Audit/Dispatch.pm:193)
      Can't locate object method "Newsgate" via package "Mail::Audit::Dispatch" at /data/libs/nfo/perl/libs/Mail/Audit/Dispatch.pm line 194, <STDIN> line 16.
      x perl -MCPAN -e "install mixin"
    o check okay:
      --- snip ---  [/var/log/mail.log]
      Mar  8 07:45:55 quepasa sm-mta[31471]: h286jNeD031413: to=|"/data/opt/dispatchmail/bin/dispatchmail --base=/home/joko/virtual/joko_mail", ctladdr=<joko_mail@localhost> (1000/100), delay=00:00:32, xdelay=00:00:05, mailer=prog, pri=577260, dsn=2.0.0, stat=Sent
      --- snip ---
    
o @lookup Data::Match - Complex data structure pattern matching [by Kurt A. Stephens]
   @see also perl, Array::PatternMatcher, Data::Compare, Data::Dumper, Data::DRef, Data::Walker

o make up a notation which can explicit describe component far away
   e.g. CPAN--Hash::Merge

o @lookat News::FormReply News::FormArticle News::AutoReply

x updated phpDocumentor to version from cvs
  o trying to get uml-rendering working
    x apt-get install dia
    x apt-get install dia2code

x setup org.droogs--Autodia: location http://www.droogs.org/autodia/
  #> cd /tmp
  #> /data/opt/tools/Autodia-1.4/autodia.pl -l php -i * -p /data/www/virtual/netfrag/docs/nfo/code/flib -O
  x setup CPAN--Template: perl -MCPAN -e "install Template"
  ->CPAN--TT2
  ->CPAN--Splash!
      Which Splash! colour scheme would you like to use to build the
      documentation?  Acceptable values are:
        Name     Colours
        -------------------------
        default  lilac/mauve
        aqua     aqua/marine
        blue     grey75/blue75
        green    grey75/green75
        grey     grey75/grey50
        leon     red75/orange/white/black
        red      grey75/red75
      Enter name of colour scheme:  [default]
  ->CPAN--AppConfig
  ->CPAN--GD
    CPAN.pm: Going to build L/LD/LDS/GD-2.06.tar.gz
    NOTICE: This module requires libgd 2.0.5 or higher.
    ->Debian--libgd2: apt-get install libgd2 libjpeg62 libpng2 xlibs zlib1g
      ->Debian--debconf ->Debian--nethack-common ->Debian--xfree86-common
          !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
          Installing new version of config file /etc/X11/Xsession.d/99xfree86-common_start ...
           Adding system startup for /etc/init.d/xfree86-common ...
             /etc/rcS.d/S70xfree86-common -> ../init.d/xfree86-common
          !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
          Setting up X server socket directory /tmp/.X11-unix...done.
          Setting up xlibs (4.2.1-6) ...
          ->CPAN--Math::Trig
       ->Debian--libgd2-xpm: apt-get install libgd2-xpm libgd2-xpm-dev
          #> cd /.cpan/build/GD-2.06
          #> make
  x some further library-patches: cd /usr/lib
    #> ln -s ln -s libperl.so.5.8 libperl.so
    #> ln -s libpng.so.2 libpng.so
    #> ln -s libfreetype.so.6 libfreetype.so
    #> ln -s libjpeg.so.62 libjpeg.so
  x test:
    #> ld -l png|jpeg|freetype|perl|X11
    X11 still fails with make GD!!!
    #> cd /.cpan/build/GD-2.06
    #> make
      /usr/bin/ld: cannot find -lX11
      collect2: ld returned 1 exit status
      make: *** [blib/arch/auto/GD/GD.so] Error 1
    #> apt-get install xlibs-dev
    #> make
    yai!
    #> make test
      t/GD..........ok 1/10libpng warning: Application was compiled with png.h from libpng-1.2.5
      libpng warning: Application  is running with png.c from libpng-1.0.12
      gd-png:  fatal libpng error: Incompatible libpng version in application and library
    #> apt-get install libpng2-dev
    #> apt-get install libjpeg62-dev
      ... still the same error with "make test"
    #> apt-get install libpng3 libpng3-dev
    #> apt-get install libfreetype6-dev
    The first output xml is seen! Great! Let's move on to graphviz:
      Can't locate GraphViz.pm in @INC (@INC contains: /data/opt/tools/Autodia-1.4 /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl .) at /data/opt/tools/Autodia-1.4/Autodia/Diagram.pm line 336.
    #> apt-get install graphviz
    ???#> perl -MCPAN -e "install Template"
    #> perl -MCPAN -e "install Graphviz"
      ->CPAN--IPC::Run
      ->CPAN--Graph
      ->CPAN--Math::Bezier
      ->CPAN--Heap
    Freetype Font's do not work!
    #> apt-get install freetype2-tools
    #> apt-get install libttf-dev
    #> apt-get install xfonts-scalable
    #> apt-get install xfonts-base
    #> apt-get install ttf-freefont
          Freefont Serif, Sans and Mono Truetype fonts:
          A set of free high-quality TrueType fonts covering the UCS character set. 
          These fonts are similar to the (in)famous Helvetica, Times and Courier fonts. 
          http://packages.debian.org/unstable/x11/ttf-freefont.html
    (#> apt-get install ttf-xfree86-nonfree ttf-larabie-deco ttf-larabie-straight ttf-larabie-uncommon)
    #> defoma-font register-all /etc/defoma/hints/ttf-freefont.hints
  o enhance:
      root@quepasa:/home/joko/public_html/test# ./.autodiarc
      getting pattern for php
      using directory : /data/www/virtual/netfrag/docs/nfo/code/org.netfrag.glib
      recursively searching files..
    o the "php-pattern" should also contain namespaces and stuff
      (components gets instantiated by either 'mkObject' or 'php::mkComponent')
      make this possible!
    
o quick (javascript) search for netfrag.org and packages.debian.org (xul?)

o phpDirectoryIndex:
  o integrate Joshua Eichhorns 'auth' [[http://cvs.joshuaeichorn.com/cvsweb.cgi/auth/]]
  o hide more entries: e.g. 'CVS' (declare as "cvs-repository-metadata" - "hidden by default")

@lookat http://cvs.joshuaeichorn.com/cvsweb.cgi/phpXmlTransform/

o autodia: enhance with "projects"
   <-> couple with phpDocumentor
   
o phpDocumentor: try php 4.3.0 for having cross-indexed browsable source as an additional feature ;-)
  o <-> link to pages prepared by Autodia
  o add additional browser in top left frame for cross-domain-browsing (having multiple apis beside each other)
  o the html-title! (make it unique!!!)
  
o for Autodia: 
  o resize images to a) 800x600 portrait and b) DIN A 4 square or s.th.l.th.
    => x .autozoom -> zoomall -> zoommulti -> zoomone
  o stamp picture with header and footer (little expressions for including predefined title, current filename, date, etc.!)
  o idea: render as SVG???
  o class- and package-diagrams:
    o "Class" for relationships of Code- and DB-Schema-classes
    o "Package" for relationships of code-packages
  o integrate with phpDocumentor:
    /data/opt/tools/phpdocumentor/phpDocumentor/Converters/HTML/frames/templates/phpedit/templates/left_frame.tpl
  o Autodia-TODO:
    Add ability to split projects into multiple diagrams and group contents of
    a diagram/subdir into system boxes - much improving clarity in big
    projects.

o glib-namespace aufräumen!

o twingle
  o what about "<pre>"-blocks?
  o what about non-html-tags (e.g. <optional-var-name>)?
   => we'll probably need a html-tag-db to solve this 
  o establish as RunnerAgent and IntervalRunnerAgent on quepasa!

o phpDocumentIndex
  o recognize symlinked directories!!!
  o integrate with ImageZoom written for Autodia
    -> manipulate images: zoom, rotate
  o sort order: 
    o default: show directories on top
    o make changable through columns
  o option to force view of hidden files (e.g. dot-files)
  o 24h-time-format (no AM/PM)
  o UML-Class-diagram-icon for tutorial!!!

o modify /etc/hosts entry by rule!!!!

o Yakka: automate reinstallation (new IntervalRunnerAgent) of libxml2
  #> dpkg -i /home/bareface/public_html/yakka/data/libxml2_2.4.19-4_i386.deb
  #> /etc/init.d/apache restart

o autozoom/runzoom
  o from (e.g. test6/)
  o to (e.g. test6/zoomed/)

o global "last-recent-error"-page for admin to view errors occouring
  ->SystemErrors
  ->StepProcessing: ./.runrc: update|build|publish

o clean up disks!!!
  o h1.service.netfrag.org
  o quepasa.netfrag.org

o natraj/sorceress: server-consolidation?

o monitor regularly: http://netfrag.org/docs/code/api/org.netfrag/errors.html

o DataSource::Generic <-> ObjectList!!!

o Yakka: (javascript-control):
  o let CTRL + ENTER make a new para
  o let CTRL + CTRL (double-hit) make a new page from WikiWord left of the cursor (splash into a new DHTML page!)

x root@quepasa:/data# apt-get install pdumpfs

o final solution for the libxml-problem?
  root@quepasa:/home/service/backup# apt-get --fix-broken --show-upgraded --simulate dist-upgrade
    Reading Package Lists... Done
    Building Dependency Tree... Done
    Correcting dependencies... Done
    Calculating Upgrade... Done
    The following packages will be REMOVED:
      libxslt1 php4-domxml
    0 packages upgraded, 0 newly installed, 2 to remove and 0  not upgraded.
    Remv libxslt1 (1.0.27-1 ) [php4-domxml ]
    Remv php4-domxml (4:4.2.3-11 )
  root@quepasa:/tmp# apt-get install pdumpfs
    Reading Package Lists... Done
    Building Dependency Tree... Done
    You might want to run `apt-get -f install' to correct these:
    Sorry, but the following packages have unmet dependencies:
      libxslt1: Depends: libxml2 (>= 2.5.0-1) but 2.4.19-4 is to be installed
      php4-domxml: Depends: libxml2 (>= 2.5.0-1) but 2.4.19-4 is to be installed
    E: Unmet dependencies. Try 'apt-get -f install' with no packages (or specify a solution).
  x dpkg --force-depends -r libxml2
  o dpkg-liftpackage libxml2_2.4.19-4_i386.deb 2.5.0-1
    x dpkg-deb -x libxml2_2.4.19-4_i386.deb fakepkg
    x dpkg-deb -e libxml2_2.4.19-4_i386.deb
    x mv DEBIAN fakepkg/
    x dpkg-deb --build fakepkg libxml2_2.4.19-4_i386_fake_2.5.0-1.deb
    x dpkg -i libxml2_2.4.19-4_i386_fake_2.5.0-1.deb

o announce on www.netfrag.org
  o api-doc
  o packages.netfrag.org (libxml2!)
  o autogenerate: 
    o api-doc & diags
    o twingle

o ->search.netfrag.org/ruby

o install and use 'monit' to monitor uml's!

o refactor Yakka::YakkaSetup

o quepasa - Error: AMaViS

   <screen>
    Starting AMaViS Daemons: amavis-milter amavisd
    Can't locate Razor/Client.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl) at /usr/sbin/amavisd line 54.
    BEGIN failed--compilation aborted at /usr/sbin/amavisd line 54.
   </screen>

  - probably because of perl-5.8.0?

  x apt-get install razor   #)§$&(
  solution:
    x dpkg --force-depends -r razor
    x wget http://ftp.de.debian.org/debian/pool/main/r/razor/razor_1.20-1_all.deb
    x dpkg -i razor_1.20-1_all.deb
     => depends on 'libtime-hires-perl', so:
      x wget http://ftp.de.debian.org/debian/pool/main/libt/libtime-hires-perl/libtime-hires-perl_1.20-4_i386.deb
      x dpkg -i libtime-hires-perl_1.20-4_i386.deb
        dpkg: dependency problems prevent configuration of libtime-hires-perl:
         libtime-hires-perl depends on perlapi-5.6.0; however:
          Package perlapi-5.6.0 is not installed.
          ;-( /)(%(/$%%&$
    => removing dependencies about everything from razor1-package
      x dpkg -x razor_1.20-1_all.deb razor
      x dpkg -r razor_1.20-1_all.deb
      x mv DEBIAN/ razor/
      x do: remove line 'Depends:' from DEBIAN/control
      [x chmod -R 0755 razor/DEBIAN/] maybe!  (if: dpkg-deb: control directory has bad permissions 2755 (must be >=0755 and <=0775))
      x dpkg -b razor razor_1.20-1_all_nodeps.deb
      x cp razor_1.20-1_all_nodeps.deb /data/Packages/dists/stable/contrib/binary-i386/
    =>
      x dpkg -i /data/Packages/dists/stable/contrib/binary-i386/razor_1.20-1_all_nodeps.deb
    => [test]
      x /etc/init.d/amavis-milter start
       <screen>
        Can't load '/usr/lib/perl5/auto/Time/HiRes/HiRes.so' for module Time::HiRes: /usr/lib/perl5/auto/Time/HiRes/HiRes.so: undefined symbol: PL_stack_max at /usr/lib/perl/5.8.0/DynaLoader.pm line 225.
         at /usr/sbin/amavisd line 46
        Compilation failed in require at /usr/sbin/amavisd line 46.
        BEGIN failed--compilation aborted at /usr/sbin/amavisd line 46.      
       </screen>
    => [CPAN-install]
      x perl -MCPAN -e "install Time::HiRes"
       <screen>
          [...]
          compile -- compile -- compile
          [...]
          Running make install
          Installing /usr/lib/perl/5.8.0/auto/Time/HiRes/HiRes.so
          Files found in blib/arch: installing files in blib/lib into architecture dependent library tree
          Installing /usr/lib/perl/5.8.0/Time/HiRes.pm
          Installing /usr/share/man/man3/Time::HiRes.3pm
          Writing /usr/lib/perl/5.8.0/auto/Time/HiRes/.packlist
          Appending installation info to /usr/lib/perl/5.8.0/perllocal.pod
            /usr/bin/make install  -- OK
       </screen>

  x probably because of perl-5.8.0? yes!  --  is it fixed now? let's try...  (again)
      x /etc/init.d/amavis-milter restart
        no! same error as above!
      the problem is:
      watch the output of 'perl -V' - at the bottom:
      <screen>
        Characteristics of this binary (from libperl):
          Compile-time options: MULTIPLICITY USE_ITHREADS USE_LARGE_FILES PERL_IMPLICIT_CONTEXT
          Built under linux
          Compiled at Feb 17 2003 12:38:57
          @INC:
            /etc/perl
            /usr/local/lib/perl/5.8.0
            /usr/local/share/perl/5.8.0
            /usr/lib/perl5
            /usr/share/perl5
            /usr/lib/perl/5.8.0
            /usr/share/perl/5.8.0
            /usr/local/lib/site_perl
            .
      </screen>

      The bad one is the "old" shared object coming with Time::HiRes for perl-5.6.1 living at
      /usr/lib/perl5/auto/Time/HiRes/HiRes.so.
      
      We have these options:
        1. delete this stuff
        2. put a better version at '.'
        3. place line '/usr/lib/perl/5.8.0' above of '/usr/lib/perl5'
        4. copy stuff from '/usr/lib/perl/5.8.0' to '/usr/lib/perl5'
      
      Hmmm.....
        I think i'll choose option 1.:
        x rm -rf /usr/lib/perl5/auto/Time/HiRes
        (or if you don't wanna be as brute-force)
        x cd /usr/lib/perl5/auto/Time
        x mv HiRes HiRes.old
        
    => let's try again:      
      x /etc/init.d/amavis-milter restart
        Time::HiRes object version 1.42 does not match bootstrap parameter 01.20 at /usr/lib/perl/5.8.0/DynaLoader.pm line 245.

    => ahhh...  (also testable via 'perl -MTime::HiRes')
      x dpkg --force-depends -r libtime-hires-perl
      => my fault! ;-)

  => so, everything works fine now....
      x /etc/init.d/amavis-milter restart
    
o BER.pm:  BER (Basic Encoding Rules) encoding and decoding.

o use a common [[http://razor.sourceforge.net/artistic.html|"Artistic License"]]?

o use pdumpfs!

o what we build seems similar to Torque <-> Maven  (Tangram|XyZ+Data::Storage <-> nfo-libs|rap)

o write meta-documentation about why it's required to lift version-numbers of debian-packages
  -> Why dpkg-liftversion?
  1. yakka: libxml2!!!
  2. amavis-milter: razor-1-branch-required

o installing pdumpfs as system-wide backup-system:
  x mkdir -p /home/service/virtual/pdumpfs/var/data
  x mkdir -p /home/service/virtual/pdumpfs/var/log
  x cd /usr/local/bin
  x ln -s /home/service/virtual/pdumpfs/backup .

o feature: BrowsableBackup:
  o missing: authentication via LDAP....

o make up toolpack from shortcuts/*, dispatchmail, backup (->pdumpfs), etc...
  ->packages.service.netfrag.org
  -->/usr/local/bin
  
o one account - three services:
  o wiki
  o news
  o backup
  (o ssh) (not-a-must)

o dpkg-modcontrol!!!

o robinson - purge package dependencies from .deb- or .rpm-packages
  can alien do that?

o rsync working: view from the server-side:
 3968 ?        R      0:40 rsync --server --sender -vulogDtprz . /home/service/backup/

x finally: we have a backup-system!
  - built on top of pdumpfs (ruby!), gets triggered by cron through shortcut-script 'backup'
  - backs up:
    x /home/*   (except /home/service)
    x /data/bin  (approx. 9.2M)
    x /data/libs  (approx. 1.7M)
    x /data/opt  (approx. 27M)
    o /data/var  (approx. 104M)
      o mysql-db
      o news-spool
    o /data/www  (approx. 126M)
      x /data/www/virtual/lashlarue  (approx. 28M)
      x /data/www/virtual/netfrag  (approx. 68M)
      x /data/www/virtual/wac  (approx. 4M)
  o productive backup should go to /var/pdumpfs (similar to /var/backup) instead of /home/service/virtual/pdumpfs!!!
  o prevent recursive backups (what happens if the backup directory itself would be specified to backup???)
  => #> crontab -e
        adding line: 03 03 * * * bash /home/service/virtual/agent/backup_all
  o limit size of files that are backuped without user-request!?! (2MB, 10MB, 100MB, 1G)

o establish logfile-rotation with logrotate!!!
  #> cd /data/www/virtual/lashlarue/log
  #> gzip access_log
  #> gzip error_log

o more todos:
  x clean more diskspace
    - How to find files larger than, hmm, let's say: 512MB?
      use 'dus'! [Disk Usage Sorter]
      http://marginalhacks.com/bin/dus
    - now disk-usage-stats are prepared to be generated at service.netfrag.org (dus/fbf)

    - h1.service.netfrag.org
      /dev/hda7             38570848  33162404   5408444  86% /


    o /home/uml/skels aufräumen!
  o draw more diagrams
  o let 'monit' monitor our umls
    - together with heartbeat!
  o make more backups
    databases: code (repository) and rdbms-sql (mysql)

o look in /var/log/syslog after crash! (other logfiles?)

o h1.service.netfrag.org:
  rjoko@h1:/home/uml/helo # monit
  monit: error while loading shared libraries: libssl.so.2: cannot open shared object file: No such file or directory
  rjoko@h1:/home/uml/helo # deleeeeete backup!!! is it reeaaady?

x h1.service.netfrag.org - ssh-upgrade [security]

  rjoko@h1:~ # ssh -V
  OpenSSH_2.9p2, SSH protocols 1.5/2.0, OpenSSL 0x0090602f  

  #> cd /home/public/archive/security
  fetch recent versions from (e.g.) ftp://ftp.openbsd.org/pub/OpenBSD/OpenSSH/portable/rpm/RH73/

  rjoko@h1:~ # ssh -V
  OpenSSH_2.9.9p2, SSH protocols 1.5/2.0, OpenSSL 0x0090602f

o what about legolas?

o search-shortcut to rpmfind.net

o request to hetzner:
  please delete handle "CNO: MM458-ABC"...

o prevent errors like seen on http://netfrag.org/cgi-bin/viewcvs.cgi/joko/virtual/joko_mail/

MailToCvsAdmin">MailToCvsAdmin	ViewVC Help
Powered by ViewVC 1.1.26