joko's sample notes - 2003-01 - InventoryCleanupAndRefactoring





AIMS:
    - Convert this document into a data-structure and back.
    - Don't loose a bit of information.
    - Make possible to link to all resources available.

for working with it
    - global metadata
        - cvs-loginfo/commitinfo
    - ItemMetadata
        - ItemStatus (open, closed and stuff)
        - ItemAuthor
        - ItemType
        - ItemIdentifier
        - references/associations to/from
    - word metadata
        - link to target
        - show target as ...
    - overview of all gathered metadata (at the bottom)

for rendering it
        - render at as [in ] [to this ]




joko@netfrag.org - sample stack:

o get (and refactor) from janosch:
    - serial-interface-perl-scripts (3?)
        - aquastar.pl
        - relais.pl
        - xyz
    x faxGate.pl: mail-handler (Faxversandmodul)

o gtk radiant

o serial-line to eagle.psl.netfrag.org

o rabit: php-gtk-ide (phpMole?)

x mail links to jonen

o Quake SDK (bots, ....)

o 3dmax: Reactor

o look at tools @ perl/bin!!!

o trim ~joko/Mail/.rules.pm for new Mailing Lists and CVS Logs (from CVSSpam)

o get into ExtUtils::MakeMaker!!!

o glossary: sync = get|send new mail & publish|announce

x new mechanism to pass configuration-metadata to Torus: 'config_metadata => { file => '../etc/syncOutlookContacts.ini' }, ' and stuff....

o TUTOS - to (static) report:
    o Overview - All Projects: http://www.netfrag.org/tutos/php/product_overview.php?name=
    o Statistics - All Projects: http://www.netfrag.org/tutos/php/product_overview.php?format=&start=0&format=stat
    o Timetrack Summary - per User: http://www.netfrag.org/tutos/php/timetrack_overview.php?worker=1036
    look at:
    http://www.netfrag.org/tutos/php/res_cal.php?id=1036
    http://www.netfrag.org/tutos/php/timetrack_overview.php?worker=1036

o Torus/XML
    -----------------------------------------------------------------------------
    Torus::addItem
          
        
        
            
                  

        

    

    -----------------------------------------------------------------------------

o register: archive.netfrag.org

x already archived somewhere in mail-history
        Data::Transfer::Sync::API::syncNodes
            Data::Transfer::Sync::Core::_syncNodes
                Data::Transfer::Sync::StorageInterface::_getNodeList( source )
                Data::Transfer::Sync::StorageInterface::_resolveNodeIdent( source )
                Data::Transfer::Sync::StorageInterface::_statloadNode( target )
                Data::Transfer::Sync::Compare::Checksum::_readChecksum( source )
                Data::Transfer::Sync::Core::_buildMap
                Data::Transfer::Sync::Core::_doTransferToTarget( insert|update )
                Data::Transfer::Sync::StorageInterface::_statloadNode( target )
                Data::Transfer::Sync::Compare::Checksum::_readChecksum( target )
                (Data::Transfer::Sync::Core::_doModifySource_IdentChecksum)

o shortcut url: Detailed History (Tracker): http://www.netfrag.org/tutos/php/history_show.php?id=1054

o glossary: "bind data" (add relationships and stuff...)

o accounts for jonen, janosch and bareface (and all others) for inn@news.netfrag.org

x outlook2ldap: win32, perl-5.8.0:
        ---> App::Config (CPAN, force)
        Tie::IxHash (CPAN)
        Log::Dispatch (CPAN)
        Log::Dispatch::Config (CPAN, force)
        mixin (ppm)
        DBI (ppm)
        Hash::Merge (ppm)
        Tie::SecureHash (ppm)
        ---> Date::Manip (CPAN)
        ---> Net::LDAP (own)

o integrate TUTOS and sloccount!? the "costs"?

o refactor DesignPattern:: to Data::Code::Object

o create apache conf statically|dynamically from some declaration stored in ldap

o misc
    cd /tmp
    umount /data
    recover /dev/ubd/2

o implement rmtray!!! -> mv xyz /lost+found/tray/xyz
    -> [ insert project found by jonen here ]

o apache startphrase: quepasa.netfrag.org

o TUTOS FATAL ERROR Wednesday 22. Jan 2003
    =================================================================
        TUTOS FATAL ERROR Wednesday 22. Jan 2003
    14:15
    Error:
      Opening the MYSQL database MYSQL:tutos@localhost
    Detail:
      2002: Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
          TUTOS Version: 1.0.20021113
    PHP Version: 4.2.3 Linux
    PHP Config: /etc/php4/apache/php.ini
    APACHE Version: Apache/1.3.26 (Unix) Debian GNU/Linux PHP/4.2.3 mod_ssl/2.8.9 OpenSSL/0.9.6g mod_perl/1.26
    Called from: http://www.netfrag.org/tutos/php/product_show.php?id=1108
    Called by: 217.231.123.32
    PHP Info Page
    =================================================================

o Perl::Module::AutoInstall
    - detect dynamically
    - download from CPAN
    - install || force install
    - continue

o perl -MCPAN -eshell
    install Hash::Merge
    install Bundle::CPAN
    install Hash::Merge
    force install Clone
    install Hash::Merge

o apt-get install libtrash!!!

o enhance-apache-perl-configuration:
    - bug:
    root@quepasa:/tmp# /etc/init.d/apache start
    Starting web server: apacheconfiguring dynamic domain "golf5.de"
    - features!!!
    - have declaration stored in ldap:
        - ldap-company-hierarchy-containers
        - ldap-account-containers
            - metadata (nsswitch)
            - contact-information (pim (outlook|horde), notify, etc.)
        - ldap-data-containers
            - data-transfer (column/property -> column/property) mappings (via Data::Map)
            - sendmail-virtusertable & -aliases
            - mapped apache-config

o news-accounts for all@netfrag.org

o move data directories of mysql and ldap physically below /data (/var/lib/...)

o backup-scripts:
    - lowlevel: /data
    - highlevel:
        - mysql-databases
        - ldap-databases
        - news-spool
        - cvs-repository

o backup.pl <- backupThis.pl, backupMe.pl, backupHost.pl

o https-only-mode (configurable) for horde and tutos!

o make MX entry for news.netfrag.org!!!

o backup-MX?

x links-computing@netfrag.org -> newscollector -> recieveMail -> Mail::Audit -> news.netfrag.org:nfo.links.computing

o convert content in nfo/doc/computing/.... to DocBook - publish and link generated content @ nfoweb

o make "build.pl" read metadata from directory given (isCode? isDocBook? getFilelist!(?) getItems)
      
      

o dispatchmail - prerequisites
    CPAN
        Mail::Audit
        Getopt::Long
        Hash::Merge
        mixin
    nfo/perl/libs
        DesignPattern::Object

o check in joko's dispatchmail-rules

o misc
    o [task by joko] introduced "dispatchmail" to add mail2news-functionality to "recieveMail" (collector@netfrag.org)
    x [task by joko] migrated joko_mail from "receiveMail" to "dispatchmail"
    x [bug from joko] what about mailing from the cli / mails sent from the system (e.g. via CVSSpam):
          mail is sent out coming from @quepasa.netfrag.org
          --> how to configure just having @netfrag.org right here???
        x [resolved by jonen] CVSSpam: janosch@netfrag.org:
              x cd /etc/mail
              x nano sendmail.mc
              x add/replace line: MASQUERADE_AS(`netfrag.org')
              x make
              x /etc/init.d/sendmail reload
    o [bug from joko] "su root" is needed sometimes
          else PATH is not set correctly
          and maybe something other
          compiling fails always
    x [task by joko] these items already have been refactored into other Tasks, Notes and/or Bug Requests - this Note is just FYI.
    o [task by joko] dispatchmail - project work
        x README.pod -> README.html
        x link with "topics.html" properly
        x write something about data-/control-flow to README.pod

o look (in detail) at Cyrus Netnews
        [...]
        The IMAP server can export netnews newsgroups as IMAP mailboxes.
        [...]
    o collectnews, rmnews, syncnews
    x seems to make an external web-based newsreader unneccessary!!!

o tie together mail, news and html
      c write mini-howto

o link with erfrakon

o sieve?

o post some old mails to news.netfrag.org!

o what about "dev@netfrag.org"?

o nfo/perl/libs
      x ts
      x outlook2ldap
      x dispatchmail
      o get the essence (project- and development work - the whole workflow) out of it! write it down! in detail!

o netfrag.org-workflow:
    o technical questions to support@netfrag.org?
    o publish them via news!
    o queue them into / integrate with TUTOS somehow!!!

o new threads@news.netfrag.org:
    x ctlinnd newgroup nfo.support.queue
    x ctlinnd newgroup nfo.support.faq

x new account for janosch@news.netfrag.org
    x nano /etc/news/nnrp.access
    x added line: *:Read Post:janosch:janosch:*

o check out from cvs-repository:
    o joko/doc -> /home/joko/public_html/computing/overview/topics/
    o leaded to (A, B and C): see home2web

o added user@netfrag.org:
    x adduser: collector/col§$

o about: some sample items occoured 2003-01-17 until 2003-01-26.
    what to do with that?
        o have all items stored in other applications conveniently.
        o be able to have items or references to them *archived* centrally
        o be able to access informations via *one* interface.
              actually *multiple* interfaces should be possible
                  - the aim here is to get everything together (INTEGRATE!) (mnoGoSearch first! Torus::Archive later?)

o refactor topics:
    o make global-accessible@netfrag.org
    o introduce subtopics
        o sysadmin tasks
        o janosch's, jonen's and joko's tasks

o start project "admintools" @ nfo/perl/scripts - including
      o getip.pl
      o notify.pl
          x on uml-event: up/down/reboot
          o on news-post (dispatchmail: mail2news)
          o on cvs-checkout (done on interval with joko/doc - see above)
          o on build (build.pl)
      o some tools from dispatchmail
      o dispatchmail itself!
      o 

o [idea] ;-) for symbols (in general)
    - o = Open Task
    - x = Closed Task
    (- [] = name of topic - fixed/proposed)
    - [ by|for ] =
            - type of topic - fixed/proposed
            - username who submitted this item / should this item be assigned to
    - this could become a language for describing the workflow
        - this proposal should be the shortcut-form in wiki-style: (e.g. make 'tiki-workflow' from that?)
        - more verbose (e.g. XML) - forms could/should become possible (e.g. 'WFML') (WorkFlow Markup|Modeling Language)
    - TODO: refactor this document after further commits to show off refactoring process through cvs-revisioning!
        o required for this: link to a page which shows the history of a document not as verbose as (e.g.) chora does
    - d = from 'tbd': to-be-discussed
    - c = cancelled

o [idea] ;-) for symbols (in _this_ document here) (parser|engine behaviour modification)
    - R = from 'tbr': to-be-refactored
    - r = already refactored elsewhere
    - an "r" may also mean "reference" ;-)
          - make 'r-http://netfrag.org/to/another/reference/wrapped/via/http/' possible in documentation
          - also the shortcut form: [r:/to/another/reference/wrapped/via/http/]
                  - this - and only this - should be the minimalst requried definition of a "reference"
                  - an internet "link" - however needs some more metadata around it: an "url" and a "caption" - what about these?
                        - either fetch them from archive-metadata of this reference ...
                        - ... or use the name directly as caption and build the url against a known redirector handler which
                            accesses the archive-metadata

o rename "thread" to "newsgroup" in all scripts!

o what about:
    Torus::Xyz - solution to reuse concepts of Apache 2 and Cyrus 2!!! (and OpenLDAP???) for building an open collaboration server?

o word-search: "identify" and "search" for

o establish global "logs/" - like at http://moose.qx.net/logs/

o add redirecting page when someone wants to access
      o http://netfrag.org/~joko/phpChoPro/ or
      o http://netfrag.org/~joko/w2hfax/

o update mail-dispatching-rules - aim: a more flat structure!!!
    o look at ilo.de/Inbox
        o marked message to Spam? Newsletters?
    x move: logs/cvs/quepasa.netfrag.org -> logs/netfrag.org
    x look at netfrag.org/Inbox
        x if subject matches "Cron " set target "logs/netfrag.org/joko/cron" [push over cron]
            x mkdir Mail/SORTED/netfrag.org/joko
            x touch Mail/SORTED/netfrag.org/joko/cron
        x if subject matches "quepasa daily usenet report" at begin set target "logs/netfrag.org/system/applications" [push over inn]
        x if subject matches "[CVS" at begin set target "logs/netfrag.org/cvs" [push over CVSSpam]
        x if mail is from myself set target "me2myself"
        x moved some folders
            x move already existing file to folder
                x mv logs/netfrag.org/system logs/netfrag.org/system.tmp
                x mkdir logs/netfrag.org/system
                x mv logs/netfrag.org/system.tmp logs/netfrag.org/system/applications
            x mv netfrag.org/Status/h1.service.netfrag.org logs/netfrag.org/system/
            x mv netfrag.org/Status/TWikiChanges logs/twiki.org/ChangeLog
                x mkdir logs/twiki.org
                x do changes in .dispatchmailrc - always - ;-)
            x mv netfrag.org/Status/quepasa.netfrag.org logs/netfrag.org/system/
            x blocked email-partition *partition*! - email-partition(!) -> WordFinder
                x mkdir ../FILTERED
                x mv netfrag.org/Status/Spam ../FILTERED
                x mv netfrag.org/Status/Test misc/
            x mv netfrag.org/Status/Postmaster\ Routing misc/Postmaster
            x rmdir netfrag.org/Status/
    x look at netfrag.org/Inbox - again
                                    o look at quepasa.netfrag.org/Inbox
        o [Multisync-users]
        o [Kroupware]
    x tested the rules from above
        x echo This is a testmail. Please ignore it. | mail -s "[CVS hello]" joko
o move old mails to MailHistory
              o write parser and engine to handle above declaration: Mail::Audit::Dispatch::Interface::Script
    o add "X-"-field (X-Dispatched-By: dispatchmail-0.06 - http://netfrag.org/~joko/computing/dispatchmail/)
          o release mail from above from joko - introduce another email-address
    - e.g. work@netfrag.org, event@netfrag.org or tracker@netfrag.org (like collector@netfrag.org)

o Multisync & SyncML
    o post something to mailing-list...!?

o the '.cvslink'-mechanism:
    o type: ln -s /home/joko/public_html/_web/_cvs.php .

o LinkContainer
    - insert via drag & drop
    - shows links hierarchically

o (Self)Info - mails to yourself
    o convert all "(Self)Info" mails to
    news-messages - use "formail" and ...?

o h1.service.netfrag.org
    o base os-upgrade: suse X -> debian 3.0
      o dispatchmail
    o are Mail-Headers already added?

o workflow (PostThisLink)
    o drag link from done google-search ...
    o ... to container (at the current Task)
    o a news-post is created automagically
        o use this:
            [smtp-header-fields]
            From: expanded email-address resolved from Name|Nickname in Addressbook (via LDAP!)
            Subject: googled for ""
            [body]
            o include into mime-part if not already included
                o fetch from web on demand

o ssl/tls for inn?

o dispatchmail
    o re-link as sub-/module-project under Torus::Content::Gateway (mail2news, mail2fax)
    o -> Torus::Content - a content delivery engine
    o -> additional idea: Torus::Content::Gateway is "just" the API to "Torus::Item::Router" in this case
        o 'Torus::Content::Gateway' would then route 'Torus::Item::RFC822'-objects using 'Torus::Item::Router'
    o look at sieve - jonen posted to nfo.links.computing: [r:Message-ID: ]
    o re-link as sub-/module-project under Torus::Virtual (mail2folder, mail2mail)
        o here it acts as a dispatcher from incoming mails - TARGET gets resolved via ldap-resolvement
        o make possible: MAIL-IN -> mail2mail (via ldap-query) -> mail2fax|mail2news
    o mail2news
        x the "via-fetchmail"-solution
        x su collector
        x cd ~
        x chmod og-rwx .fetchmailrc

o finally: do actually establish 'Torus' at 'nfo/perl/libs'

o pod: checkout how to make references which expand to html-urls
    o does pod handle this or do we need external link-expansion for this task?
    o how to make references to news-messages?
            e.g.:
            o Message-ID:
            o news://news.netfrag.org/nfo.links.computing
      o proposal(s) for "news2http" (Torus::Content::Gateway/Torus::Item::???):
            o http://news.netfrag.org/id=b0ppj7$7gv$1@quepasa.netfrag.org
            o http://news.netfrag.org/nfo.links.computing/subject=FilteringMailWithSieve of wiki
            o http://news.netfrag.org/nfo.links.computing/id=b0ppj7$7gv$1@quepasa.netfrag.org

o what about the '.nws'-files on ms? (for news-messages)

o display-mode: everything strictly hierarchical to get maximum overview!!!

x Inventory: cleaned up local and master code repositories

o add "last-updated" to "README.html"

o search.netfrag.org

o tool for the "DoThis", "DoHere", "DoAll" - series
    o FaxThis (joko/ToolBox/Windows/FaxThis)
    o tool "WinSync": (WinSync All)
        x RsyncHere
        o Contacts2Ldap

o statistics-page:
    o for cvs.netfrag.org: cvs-statistics (activeness, ...), sloccount

x home2web
    x finally - added complete /home/joko/ to cvs-repository in order to get a revisioned ".dispatchmailrc"
        x ~/.bashrc - added line: export CVSROOT=/var/lib/cvs
        x relogin: logout/login
        x cd ~
        x joko@quepasa:~$ cvs checkout -d . joko (Fri Jan 24 00:43:18 CET 2003)
        x cvs add TODO
        x cvs add .bashrc .cronrc-hourly .forward
    x added /home/joko/virtual/joko_mail
        [as joko]
        x cvs add virtual
        x chmod g+w virtual/CVS/*
        [as joko_mail
    o shortcut for (e.g.): cvs commit -m "initial check-in" .bashrc .cronrc-hourly .forward
            o cvsadd
    o add /home/root (and maybe include there some other things "lying around")

o alternative to all that Cyrus-stuff: just use the very "normal" imapd together with kerberos

o make screenshots of log-output of dispatchmail when it's ready

o base logging of 'dispatchmail' on DesignPattern::Object::Logger

o dispatchmail-mail2folder: add feature to create folders recursively

x archive mails
    x su joko_mail
    x cd ~
    x mv ilo.de/Inbox ~/MailHistory/ARCHIVED/ilo.de/2002-05-30\ -\ 2003-01-24
    x mkdir ~/MailHistory/ARCHIVED/netfrag.org/2003-01
    x mv netfrag.org/Info ~/MailHistory/ARCHIVED/netfrag.org/2003-01/
        x changed rule which formerly targeted to 'netfrag.org/Info' into 'me2myself'
    x mv netfrag.org/Inbox ~/MailHistory/ARCHIVED/netfrag.org/2003-01/
    x mkdir ~/MailHistory/ARCHIVED/netfrag.org/2003-01/Status
        x mv netfrag.org/Status/cashew.netfrag.org ~/MailHistory/ARCHIVED/netfrag.org/2003-01/Status/
        x mv netfrag.org/Status/h1.service.netfrag.org ~/MailHistory/ARCHIVED/netfrag.org/2003-01/Status/
    x mv Sent ~/MailHistory/ARCHIVED/Sent/Sent_2002-11-13_-_2003-01-24
      
o investigate LDAP-entry "mailForwardingAddress"

o establish "Mini-HowTo"

o search (allover): /^.*\.netfrag\.org/ => find all hostnames to register
      (they are scattered around in to-be-installed (web-)applications)

o Mail::Audit::Dispatch::Lookup (csv-file, ::NetLDAP, => Data::Storage::Handler::Xyz => Data::Map)

x switched mailing completely in outlook
    o Evolution!
    x now talking to 'wu-imapd' via ssl, too! - thanks to jonen!
        Jan 24 04:55:17 quepasa imapd[11508]: connect from 217.231.123.57
        Jan 24 04:55:17 quepasa imapd[11508]: imaps SSL service init from 217.231.123.57
        Jan 24 04:55:18 quepasa imapd[11508]: Login user=joko_mail host=pD9E77B39.dip.t-dialin.net [217.231.123.57]
    x now my outlook sends via 'mail.netfrag.org' using 'TLS' - thanks to jonen!
        Jan 24 04:53:09 quepasa sm-mta[11499]: STARTTLS=server, relay=pD9E77B39.dip.t-dialin.net [217.231.123.57], version=TLSv1/SSLv3, verify=NO, cipher=RC4-MD5, bits=128/128
        Jan 24 04:53:10 quepasa sm-mta[11499]: h0O3r91D011499: from=, size=435, class=0, nrcpts=1, msgid=<008c01c2c35c$5701d2a0$240aa8c0@grasshopper>, proto=ESMTP, daemon=MTA, relay=pD9E77B39.dip.t-dialin.net [217.231.123.57]

o use IMAPFilter!!!

o refactor old TODOs using 'home2web'

o webgate (like dispatchmail)

o zeit anhalten! (alle grauen männer umbringen!)

o add to cvs:
      o /home/service/
      o /home/service/virtual/collector
      o /home/service/virtual/tracker
      o /home/service/virtual/fetcher
      o /home/service/virtual/archiver

o use 'wCron' to automagically do a 'cvs commit -m "+ updated/added content" joko/doc'
    x mkdir -p C:\Programme\WCron
    x unzip -j "C:\home\amo\develop\netfrag.org\rabit\wCron\releases\WCron-0.62-pre.zip" -d C:\Programme\WCron
    o win2000: change/check permissions: right-click/Properties/Security Settings/Read, Execute = enabled
    x run it
    x add task
        x implement shortcut-script: joko/Scripts/shortcuts/cvs_commit_joko-doc.bat
            x add lines:
                x cd C:\home\amo\develop\netfrag.org\joko
                x cvs commit -m "+ updated/added content" doc

  o on Windows it's called "QuickLaunch" ....

o plugins for nautilus/gnome/kde:
    show arbitrary data-structures (from anywhere): here we may get the drag & drop - functionality "on-the-fly"

o new user "gateway":
    x adduser --home /home/service/virtual/gateway gateway (pass: gw%R%)
    x mkdir /var/lib/cvs/gateway
    x chown -R gateway.gateway /var/lib/cvs/gateway
    x su gateway
    x cvs -d /var/lib/cvs checkout -d ~ gateway
      x error on quepasa:
        Jan 24 19:00:09 quepasa sm-mta[17960]: STARTTLS=server, relay=pD9E77B39.dip.t-dialin.net [217.231.123.57], version=TLSv1/SSLv3, verify=NO, cipher=RC4-MD5, bits=128/128
        Jan 24 19:00:09 quepasa sm-mta[17960]: h0OI081D017960: ruleset=check_rcpt, arg1=, relay=pD9E77B39.dip.t-dialin.net [217.231.123.57], reject=550 5.7.1 ... Relaying denied. Proper authentication required.
    x add to /etc/mail/default-auth-info
        sendmail
        sendmail
        sendmailpwd
        quepasa.netfrag.org
    x /etc/init.d/sendmail restart

o Torus::Publish::ReWeb
      o googling for something automagically opens a new task
      o all links directly or indirectly coming out of this are sorted below this task
      o the user can end this task on demand: timetracking is done automagically as well
        o register tutos.netfrag.org

o qpopper with tls, sasl and kerberos5?

o off realtime! the only thing that happens at realtime is MailMiltering.
      x cvs checkout of joko/doc is done via cron
      x mail2news-dispatching is now done via cron (would be possible "in realtime" via '.forward'ing the mail *directly* to dispatchmail)

o ctlinnd newgroup nfo.csm (Collaborative System Management)

o make possible:
    o after "cvs update" make question: "Found new items in "" while scanning. Should i add them to the repository?"
    o drag & drop arbitrary items out of outlook (.msg, .nws, etc.) - search for them while scanning the fs and sync them
          against *original* source. (e.g. 'Message-ID: ')

x CVSSpam -> nfo.log.cvs
    x su root
    x cd /etc/mail
    x nano virtusertable
    x add line:
        x cvs-log@netfrag.org gateway
    x make virtusertable
    x su gateway
    x cd ~
    x nano .dispatchmailrc
        x add lines:
            $self->copy('Newsgate', 'nfo.log.cvs')
                if $to =~ m/cvs-log/;
    x exit (to logout)
    x cvs update CVSROOT/loginfo
    x add to CVSROOT/loginfo (to the end of the line starting with '^nfo '):
        --to cvs-log@netfrag.org
    x cvs commit -m "+ added new notification target: 'cvs-log@netfrag.org'" CVSROOT/loginfo
    x tested with some mini-howto
    x removed '--to joko@netfrag.org --to jonen@netfrag.org --to bareface@netfrag.org --to janosch@netfrag.org '
          from CVSROOT/loginfo for module 'nfo'
    x announce this
        x added to '/etc/news/nnrp.access':
            *:Read Post:bareface:bareface:*
        x /etc/init.d/inn reload

x add 'gateways'-repository to chora
    x nano /data/www/doc/horde/chora/config/cvsroots.php
    x add lines:
        # 2003-01-24, joko
        $cvsroots['gateway'] = array(
                'name' => 'gateway',
                'location' => '/var/lib/cvs/gateway',
                'title' => "$titlePrefix gateway's CVS Repository",
                'cvsusers' => $cvsusers,
        );

x configured Apache for serving news.netfrag.org
      x cleaned up /data/www/virtual/netfrag/conf/httpd.conf
            x ./test.conf
            x comments
      x /etc/init.d/apache reload
      x test: http://news.netfrag.org/
        o new module for cvs-repository?
      o nfo/layouts/fs/skel/data2
      o checkout to /data on quepasa.netfrag.org
      x done:
            x su root
            x cd /var/lib/cvs
            x mkdir -p nfo/layouts/fs/skel/data
            x mkdir -p nfo/layouts/fs/skel/data2
            x mkdir -p nfo/hosts/quepasa.netfrag.org/data
            x cvs -d /var/lib/cvs checkout -d /data nfo/hosts/quepasa.netfrag.org/data
                x *mungle everything and commit!* look at the repository!
            x add special group with access to this repository: 'rootsrc'
                x groupadd rootsrc
                x usermod -G src,staff,rootsrc joko
                x usermod -G src,staff,rootsrc jonen
                x usermod -G rootsrc root
                x change permissions
                    x cd /var/lib/cvs/nfo/
                    x chown -R .rootsrc hosts
                    x chmod -R g+w hosts

          x add to system-conf-repository:
    x /etc/mail
    x php: cvs-redirect
    x 
      o extend WCron
      x show (per-task) if it's currently running or not: provide buttons to (start, stop, pause, resume or cancel a task...)
      x use as a frontend for administering nfo/libs/perl/ - backend - tasks(???)
        x install Horde/Troll
      x install troll
          x cd /home/service/download
          x mkdir horde
          x cd horde
          x wget ftp://ftp.horde.org/pub/troll/troll-0.0.2.tar.gz
          x tar -xzf troll-0.0.2.tar.gz --directory=/data/www/doc/horde/
      x configure horde
          x cd /data/www/doc/horde/
          x nano config/registry.php
                x add lines:
                  $this->applications['troll'] = array(
                          'fileroot' => dirname(__FILE__) . '/../troll',
                          'webroot' => $this->applications['horde']['webroot'] . '/troll',
                          'icon' => $this->applications['horde']['webroot'] . '/troll/graphics/troll.gif',
                          'name' => _("News"),
                          'allow_guests' => true,
                          'show' => true
                  );
            x configure Troll
                x cd troll/config
                x conf.php
                    x cp conf.php.dist conf.php
                    x nano conf.php
                    x edit:
                        x $conf['news']['server'] = 'news.netfrag.org';
                        x $conf['news']['mailserver'] = 'mail.netfrag.org';
                x servers.php
                    x cp servers.php.dist servers.php
                    x add:
                        $servers['netfrag.org'] = array(
                                'name' => 'news.netfrag.org',
                                'server' => 'news.netfrag.org',
                                'port' => 119,
                        );
                x prefs.php
                    x cp prefs.php.dist prefs.php
                x html.php
                    x cp html.php.dist html.php
                x permissions
                    x chmod o+r *.php
                                                    x test: http://netfrag.org/horde/
                o another (more bright) skin for horde@netfrag.org!!!
                  o Warum nicht überall Horde? Sondern TUTOS?
      o Horde ist sehr breit angelegt, dafür fehlt es jedoch an vielen Stellen noch ein wenig im Detail.
      o mittlerweile: mit Hermes & Co.? nochmal ansehen!

o just do automated operations (like cvs commit) only if system is idle

o automagically redirect http://netfrag.org/horde/ to https://netfrag.org/horde/
    o with an Apache - rewrite-rule?
      x how to map TUTOS-groups to newsgroups?
    x ctlinnd newgroup nfo.tutos.sysadmin
    x add dispatching for sysadmin@netfrag.org
        x add to /home/service/virtual/gateway/.dispatchmailrc
            $self->copy('Newsgate', 'nfo.tutos.sysadmin') if $to =~ m/sysadmin/;
        x add to /etc/mail/virtusertable:
            # --- news.netfrag.org - joko, 2003-01-24
            sysadmin@netfrag.org gateway
            make virtusertable!
        x write welcome-mail
            root@quepasa:~$ mail sysadmin@netfrag.org
            Subject: Welcome to the sysadmin-newsgroup at netfrag.org!
            Have fun!
            greets, joko.
                          .
            Cc:
        x test: do "refresh newsgroups" at your favourite news-reader
    x this has been refactored to: [news:id=b0shbj$l9s$1@quepasa.netfrag.org]
        x HEADERS:
            x Message-ID:
            x Subject: Re: Welcome to the sysadmin-newsgroup at netfrag.org!
        o newsgate
            o http://news.netfrag.org/nfo.tutos.sysadmin/id/b0shbj$l9s$1@quepasa.netfrag.org
            o http://news.netfrag.org/nfo.tutos.sysadmin/subject/Re: Welcome to the sysadmin-newsgroup at netfrag.org!

o Erkenntnis aus UML (Kernel 2.4): schwierig mit gleichzeitigem Zugriff

o gave up trying to get Troll running

x setup alternatives to Horde for public access
    o viewcvs
        x apt-get install libapache-mod-python
              o WebNewsViewer
      o release the user from having to send email-messages to actually post urls with content (e.g. "FirstPage")

o parse .url-files!

o have newsgroup-structure backed in ldap-container (ou) somehow (Data::Map!)

x new email-addresses@netfrag.org:
    x sysadmin@netfrag.org
    x faq@netfrag.org
      x --rework|*reworked*-- apache-layout - check into repository as something root is responsible for!

x --setup|*setting up*-- newsportal (by Florian Amrhein)
    x url: http://florian-amrhein.de/newsportal/
    x cd /home/service/download
    x mkdir newsportal
    x cd newsportal
    x wget http://florian-amrhein.de/newsportal/download/newsportal-0.24.tar.gz
    x mkdir -p /data/www/virtual/netfrag/sites/news/apps/newsportal/
    x tar -xzf newsportal-0.24.tar.gz --directory=/data/www/global/apps/newsportal/
    x add to /data/www/virtual/netfrag/conf/applications.conf
        Alias /webnews/ /data/www/global/apps/newsportal/
    x configure in /data/www/global/apps/newsportal/config.inc
        // newsserver setup
        $server="news.netfrag.org";
        $server_auth_user="webnews";
        $server_auth_pass="web123";
    x add to /etc/news/nnrp.access:
        # 2003-01-26, joko
        *:Read Post:webnews:web123:*
    x modify groups.txt
        
        o TODO: AUTOUPDATE here!
    x add to the index-page:
        xR set INSERTION=""
        x grep -rin "             doc/readme-deutsch.html:4:
            doc/faq.html:4:
            doc/history.txt:234:- fehlender Tag ergaenzt
            doc/readme-english.html:4:
            doc/history.txt~:233:- fehlender Tag ergaenzt
            extras/frames/thread_frameset.php:10:
            head.inc:5:
        x cvs add head.inc
        x cvs commit -m "+ initial commit" head.inc
        x 
            x nano head.inc
            x  STRG+W + T: 5
            xR
            xR
            x  STRG+O + [ENTER]
        x test: http://www.netfrag.org/webnews/>
            o TODO: RefactorThisHtmlRef to WebNews
        o view message in some MimeViewer or HtmlViewer (Horde?)
            o -> use a MessageViewer with MimeCapabilities and HtmlCapabilities
    x Why newsportal and no other?
        x directly connects to nntp-daemon
        x has local spool (o TODO: purge regularly?)
        x highly customizable
            x added custom css-stylesheet and changed something at content-rendering-level without any problems
            x visit cvs.netfrag.org to look at the changes made to the newsportal codebase:
                x -> newsportal at cvs.netfrag.org
                    o TODO: RefactorThisLink
        x it's just easy!
    x setup dispatchrequest for http://news.netfrag.org
        x cd /data/www/virtual/netfrag/sites/news/
        x create symlink
            x ./.symlinkrc
        x copy over from webcvs
            x cp ../webcvs/index.php .
            x mkdir .dispatch
            x cd .dispatch
            x cp ../webcvs/.dispatch/config.php .
            x cp ../webcvs/.dispatch/index.php .
        x cvs add ...
        x cvs commit ...
    x added|*adding* dispatcher at http://news.netfrag.org
        x used and mungled DispatchRequest(->cvs, ->doc, ->search) for this purpose
            o IdeaFor ParseDoc: expand: cvs=JumpToCvs, doc=JumpToDoc, search=SearchFor
                x examples for the JumpToCvs mechanism are shown on x tested http://cvs.netfrag.org/ - still working...
        o AddedFeatures to DispatchRequest:
            x JumpToNewsgroup: http://news.netfrag.org/nfo.tutos.sysadmin/
                e.g. ->http://netfrag.org/webnews/thread.php?group=nfo.links.computing
            o JumpToThread: NotYetImplemented! DoWeReallyNeedThis?
            o JumpToArticle: http://news.netfrag.org/nfo.sysadmin.tutos/id/b0shbj$l9s$1@quepasa.netfrag.org
            x JumpToArticle: http://news.netfrag.org/nfo.links.computing/id/44
                e.g. ->http://netfrag.org/webnews/article.php?id=44&group=nfo.links.computing

x NfoWeb
    o add WikiPages:
        o Overview
            o News
                o news.netfrag.org
            o Users
            o Development
                o Projects
                o cvs.netfrag.org
            o Documentation
                o Topics
                o MiniHowto
            o Download
            (o Search)
    o modify HomePage
        o change Projects to Overview

o yakka & pod
    o convert pod to tavi
        o perl first (pod2tavi)
        o php afterwards (pod2tavi-php)
        o then refactor to a YakkaPlugin (an "input-filter"?) ('yakka-filter-pod'?)
    o address "files" outside the normal/configured default YakkaRepository
        o introduce: "ExplicitAddressingOfArbitraryTargets"
            o via HttpHeader (GET/POST) (HtmlUrlArgument, HtmlFormField)
        o introduce "YakkaContainers": aim: group a bunch of targets/items together as a kind of "MetaRepository"

o viewcvs & yakka
    o a filesystem-adapter for yakka's storage-handler-system
    o show "view in yakka" if document-type eq 'tavi|tavi,v|pod'

o IconForNetfrag.Org?
    o fav.ico?
      x --*installed*|install-- viewcvs
    x apt-get install viewcvs
        x configured:
            x /var/lib/cvs
            x email-address (new): cvs-admin@netfrag.org -> dev@netfrag.org
            x no forbidden modules (do this via unix permissions!)
            x allow tarball generation? yes!
            x Hint: add "Alias /viewcvs/ /usr/share/viewcvs/" to /etc/apache/conf/httpd.conf for online documents and icons
                x added to '/data/www/virtual/netfrag/conf/applications.conf' in our case
            x added '' to '/etc/viewcvs/templates/header.ezt'

o rendering *proposals* for TaviWorkflow
    o Linking|Referencing (WikiWords, PureExplicitLinkExtrapolation, NamedLinks)
    o Coloring
        o [o=red, x=green, R=red, r=green]

o *shortcut*: TestApache to run 'apachectl configtest' (WikiForSystemAdministration)

x web-based newsreader? twig!
    x apt-get install twig
      o shutdown horde (for now: "pause")

o viewcvs & apache-mod-python?

o home2web, .home2webrc
    o what?
        --before: buildhtml --source=pod|tavi
        --after: say "ready"
    o hmmm...
        o buildhtml: automate various SubTasks
        o synccvs (->cvs.nfo.perl.scripts.shortcuts.synccvs.pl)
        o buildhtml (->makedoc) (->cvs.nfo.perl.scripts.shortcuts.synccvs.pl)

x added root of quepasa to cvs
    x su root
    x cd /var/lib/cvs/nfo/hosts/quepasa.netfrag.org
    x mkdir root
        x chown -R .rootsrc root/
        x chmod -R g+w root/
    x cd /tmp
    x cvs -d /var/lib/cvs checkout -d / nfo/hosts/quepasa.netfrag.org/root
    x start with /etc
        x cd /etc
        x cvs add etc
        x cvs add viewcvs
            x cd viewcvs
            x cvs add ....
            x cvs commit -m "+ initial commit"

x How to get a single file from cvs for download: (e.g.)
      wget http://cvs.sourceforge.net/cgi-bin/viewcvs.cgi/*checkout*/viewcvs/viewcvs/templates/header.ezt?rev=1.2

x cvsgraph still missing: apt-get install cvsgraph

x chora -> viewcvs
    o change logo at /usr/share/viewcvs/images
    x removed from template
    x cvsview-query.cgi didn't work yet!
        x error was:
            x tail -f /data/www/virtual/netfrag/log/error_log
            Traceback (most recent call last):
                File "/usr/lib/cgi-bin/viewcvs-query.cgi", line 50, in ?
                    import query
                File "/usr/lib/python2.1/viewcvs/query.py", line 42, in ?
                    import cvsdb
                File "/usr/lib/python2.1/viewcvs/cvsdb.py", line 34, in ?
                    import dbi
                File "/usr/lib/python2.1/viewcvs/dbi.py", line 17, in ?
                    import MySQLdb
            ImportError: No module named MySQLdb
            [Sat Jan 25 11:16:55 2003] [error] [client 217.231.127.85] Premature end of script headers: /usr/lib/cgi-bin/viewcvs-query.cgi
        x solution is:
            x apt-get install python-mysqldb
        x use mysql;
            x insert into db values ('localhost', 'ViewCVS', 'viewcvs', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
            x insert into db values ('%', 'ViewCVS', 'viewcvs', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
            x insert into user (host, user, password) values ('localhost', 'viewcvs', password('viewcvs'));
            x flush privileges;
        x cd /usr/lib/viewcvs
        x ./make-database
    x 
    o mail to author of viewcvs
          
o docu about uml and filesystem-layer running on gharb for MiniHowTo?

o search.php?wiki=1&cvs=1&index=1

x get mnoGoSearch running
    e apt-get install mnoGoSearch
    e apt-get install mnogosearch-common mnogosearch-doc mnogosearch-pgsql mnogosearch-php
    x apt-get install mnogosearch-common mnogosearch-php
        x don't overwrite configuration files
        x use 'crc-multi'
        x use 'postgres'
        x use 'mnogosearch'
    x apt-get install postgresql
        x use 'Enter default encoding (SQL_ASCII):'
                Success. You can now start the database server using:
                                          /usr/lib/postgresql/bin/postmaster -D /var/lib/postgres/data
                or
                        /usr/lib/postgresql/bin/pg_ctl -D /var/lib/postgres/data -l logfile start
                                  PostgreSQL database now installed.
                Use /usr/bin/createdb to create a specific database and
                /usr/bin/createuser to enable other users to connect to a
                PostgreSQL database.
                                  In the first instance, these commands must be run by the
                user 'postgres'.
                                  Restarting PostgreSQL database: postmaster
                No /usr/lib/postgresql/bin/postmaster found running; none killed.
                Starting PostgreSQL postmaster.
                postmaster successfully started
                .
                Enabling the PL procedural language in all PostgreSQL databases...
                plpgsql added to template1
    x apt-get install postgresql-dev
    e apt-get install libpostgresql
    e apt-get install libpgtcl
    x apt-get install mnogosearch-pgsql mnogosearch-pgsql-dev
    x dpkg-reconfigure mnogosearch-common
    x su postgres
    x /usr/lib/postgresql/bin/createuser mnogosearch
    x /usr/lib/postgresql/bin/createdb mnogosearch
          x changed to "mysql" in /etc/mnogosearch/indexer.conf and
        e deployed schemas at /usr/share/doc/mnogosearch-common/create/mysql/
            x mysql -e "insert into user (host, user, password) values ('localhost', 'mnogosearch', password('mno123'));" mysql
            c mysql -e "insert into user (host, user, password) values ('%', 'mnogosearch', password('mno123'));" mysql
            x mysql -e "insert into db values ('localhost', 'mnogosearch', 'mnogosearch', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');" mysql
            x mysql -e "create database mnogosearch;"
            x cd /usr/share/doc/mnogosearch-common/create/mysql/
            x mysql mnogosearch < categories.txt
            x mysql mnogosearch < crc-multi.txt
        x deployed schemas at /usr/share/doc/mnogosearch-common/create/pgsql/
            x psql -U mnogosearch mnogosearch < create.txt
            x ...
        x added to /data/www/virtual/netfrag/conf/applications.conf
            php_value include_path /usr/share/mnogosearch-php:/etc/mnogosearch-php
            Alias /search/ /var/www/search.php
        x apt-get install php4-pgsql
                  x !!! jonen made mysql-mode apts for mnogosearch-common_3.2.6-2.SU.1_all.deb !!!
            use them: [...] ->archive:/path/to/debs

o it's not tavi nor tavi-workflow - it's: JustWrite? it's todo! (.todo -> .justdo -> .justwrite -> .done)

o ScanToWeb

o look at Mailman: http://www.list.org/features.html

o use cvsup!?

o alien.netfrag.org - (package-conversion) --> alien.packages.netfrag.org

o chora2viewcvs - How to migrate from Horde/Chora to viewcvs.

o LinuxInCvs (linux2cvs)

o TestApacheConfig, StopApache, StartApache have to work without any running Apache - of course!

o through "viewcvs" we loose the ability to "publish" documents via former chora:
      viewcvs takes care to keep documents like they are in their original - so ".html"-files should be shown with text/plain

o re-integrate .cvslink/JumpToCvs with dispatchurl

o WikiWords in CvsCommitMessages? (via yakka?)

x http://cvs.netfrag.org/bareface/yakka/?tarball=1

o [source:/link/to/source-code] (most times a '.cvslink' - hmmm?)
      [source:]

o HelpMe

o [snapshot:/link/to/snapshot]
      [snapshot:]

o dispatchrequest - a multipurpose request dispatcher
    o integrate:
        x redirector at cvs.netfrag.org ...
        o ... and news.netfrag.org
    o JumpToCvs (.cvslink-mechanism)
    o how was it done?
        x cd /data/www/virtual/netfrag/sites/webcvs/.dispatch
        x ln -s /data/www/global/apps/dispatchrequest .
                o buildhtml -> makedoc

o TWIG & yakka?

o rename: dispatchmail -> dispatchmessage

c rename: dispatchrequest -> forwardrequest?

o readrc of bashrc|perlrc|xmlrc

x setup TWIG
    x cd /usr/share/doc/twig
    x cd /data/www/virtual/netfrag/conf/
    x nano applications.conf
    x add line: Alias /twig/ /usr/share/twig/
    x had to modify /etc/apache/conf/httpd.conf:
        x added: 'index.php3'
                
                        DirectoryIndex index.html index.htm index.shtml index.cgi index.php index.php3
                

        x added: '.php3'
                AddType application/x-httpd-php .php .php3
        x /etc/init.d/apache reload
        x cd /etc/twig
            x modify config.inc.php3
        x cd /usr/share/twig/setup
            x mysql
                x use mysql
                x insert into user (host, user, password) values ('localhost', 'www-data', password(''));
                x insert into db values ('localhost', 'twig', 'www-data', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
                x create database twig;
                x flush privileges;
            x database-schema
                x gunzip twig.table.mysql.gz
                x mysql twig < twig.table.mysql
                  x setup arbitrary packet and bind to csm-system (Collaborative Software Management)
    x pinstall twig
        x apt-get install twig
        x cd /etc
        x cvs add twig
        x cd twig
        x cvs add *
        x cvs add .htaccess
        x cvs commit -m "+ initial commit"
      
o remove html from phpWiki: ('http://'!!!) (->https!!!)
             "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
    
    

o force https for: (authentication purposes - anonymous is http!)
    o horde
    o tutos
      x dpkg -x twig_2.7.5-4_all.deb tmp/

o TWIG & OpenLDAP!?

x ApacheMasterLayoutRefactoring: quepasa.netfrag.org:
    x removed /data/www/doc to /data/www/global/apps
        x test:
            x cd /data/www/virtual
            x grep -ri "/data/www/doc" *
            x cd /data/www/global
                x grep -ri "/data/www/doc" *
                x apps/twiki/
                    x lib/TWiki.cfg
                    x bin/.htaccess
                x conf/twiki-httpd
                    ---> just change between 'global' and (e.g.) 'virtual/netfrag' for switching between scopes ;-)
                    ---> the container (folder)-structure at global and sub-virtual level must match almost exactly to make this possible!!!!!
                x conf/virtualdomains-httpd/
                x doc/twiki/
    x removed: /data/www/virtual/netfrag/pub to /data/www/virtual/netfrag/sites/public
        x cd virtual/netfrag/conf
            x grep -ri "/pub" *
                x modify httpd.conf and applications.conf
    x apachectl configtest
        Syntax error on line 345 of /etc/apache/httpd.conf:
        DocumentRoot must be a directory
        x disabled there completely
        x now in /data/www/global/conf/httpd.conf
            DocumentRoot /data/www/virtual/netfrag/sites/public
    x apachectl configtest
        fopen: No such file or directory
        apache: could not open document config file /data/www/conf/twiki-httpd.conf
        x mv /data/www/global/conf/twiki-httpd.conf /data/www/virtual/netfrag/conf/
        x nano /data/www/virtual/netfrag/conf/applications.conf to match new path
    x apachectl configtest
        fopen: No such file or directory
        apache: could not open document config file /data/www/conf/tutos-httpd.conf
        x cd virtual/netfrag
        x grep -rin "www/conf" *
        x edit applications.conf:21
            x was: Include /data/www/conf/tutos-httpd.conf
            x is: Include /data/www/global/conf/tutos-httpd.conf
    x apachectl configtest
        Warning: DocumentRoot [/data/www/virtual/netfrag/sites/webnews] does not exist
        fopen: No such file or directory
        apache: could not open document config file /data/www/conf/dynamic.conf
        x grep -rin webnews *
            x edit applications.conf:30
                x was: Alias /webnews/ /data/www/global/apps/newsportal/
                x is: Alias /webnews/ /data/www/global/apps/newsportal/
            x edit httpd.conf:74
                x was: DocumentRoot /data/www/virtual/netfrag/sites/webnews
                x is: DocumentRoot /data/www/virtual/netfrag/sites/news
          x cd global/conf
          x grep -rin www/conf *
            x STDOUT-PARSE:
                httpd.conf:14:#Include /data/www/conf/httpd-php-perl.conf
                httpd.conf:16:#Include /data/www/conf/virtualdomains-httpd.conf
                httpd.conf:29:Include /data/www/conf/dynamic.conf
                    ->FILE-MODIFY: httpd.conf:29:Include /data/www/global/conf/dynamic.conf
    x apachectl configtest
            root@quepasa:/data/www/global/conf# apachectl configtest
            configuring dynamic domain "golf5.de"
            configuring dynamic domain "smartmen.de"
            configuring dynamic domain "ballonflug.de"
            Syntax OK
    x /etc/init.d/apache restart
    x testing "http://netfrag.org/" fails
    x testing "http://netfrag.org/index.php"
        x makes redirect to "http://netfrag.org/nfoweb/" but fails there
    x tail -f tail -f /data/www/virtual/netfrag/log/error_log
        [Sun Jan 26 15:32:04 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/
        [Sun Jan 26 15:33:02 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/
        [Sun Jan 26 16:37:37 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
        [Sun Jan 26 16:38:08 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
        [Sun Jan 26 16:40:10 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/

  o register:
    public.netfrag.org -> http://netfrag.org
    secure.netfrag.org -> https://netfrag.org
      o netfrag.org: DispatchRequest for http://netfrag.org/nfoweb/!
o netfrag.org: DispatchRequest for http://netfrag.org/rrr/!

o IntroduceMergePoint at http://netfrag.org/doc/
    o MiniHowto
    o faqs (e.g. from news://news.netfrag.org/nfo.faq.users

o what about an "AUTOSAVE"-feature for UltraEdit when leaving the window or
    o an AUTOCOMMIT on that very event (maybe integrated with a counter)
      o write scripts to iterate recursively through directories under specified path ...
    o ... and do some actions on each directory, e.g.
    o execute some specified .dot-files (e.g. .pod2htmlrc, .symlinkrc, .makedocrc)
      x CVSSpam in action:
    10146 ? S 0:00 /usr/sbin/sshd
    10148 ? S 0:00 /usr/sbin/sshd
    10149 ? S 0:00 cvs server
    10150 ? S 0:00 cvs server
    10151 ? S 0:00 /bin/login
    10155 ? S 0:00 /usr/bin/ruby -w /var/lib/cvs/CVSROOT/collect_diffs.rb --to joko@netfrag
    10158 ? S 0:00 /usr/bin/ruby /var/lib/cvs/CVSROOT/cvsspam.rb /tmp/#cvs.loginfo.10149.10
      x as Chora'sStylesheet has come active (by accident) when viewing this file view web
      we should include this as a fixed default making horde our default stylesheet delivery engine (for now)

o link-checker for netfrag.org

o dispatcher for style.netfrag.org redirecting to ?
    o styleme.php
    o brandme.php
      
  o mini-howto: "HttpRedirect"

o how to refactor the MiniHowtos?
    o into a wiki? wikis seem to miss offline/distributed capabilities! (for now)
    x into pod
        x build offline
        o build online
    o into DocBook?
    o into tavi? (or "TaviWorkflow"?)
    o but: LinkWithWikiAutomagically to get everything together
        o look at the InterwikiMechanism
        o look at the various WikiPluginArchitectures
        o look at YakkaDev!

o a LinkageExample: RenderThis(html4|text|html3|pdf) with [[yakka]] and [[tavi-workflow]]!
    o this could mean:
        o use the declared formats as output filters for viewing target in other formats / styles

o proposal for hierarchical structure (and HomePage) of netfrag.org
    ~overview -> SomeWiki -> Overview
        ~projects (include some common text here)
        ~users (include some common text here)
            - Page: UserArea
            - Page: ~users
    ~projects -> SomeWiki-> Projects
    ~users (include former page "User area" (now UserArea) automagically at the bottom here! (WikiInclude?))
        ~rabit (raBit's router - psl.no-ip.com)
        ~natraj (sam's place - optix)
        ~joko (joko's)
        ~bareface (->yakka)

o MasterWorkflow:
    -> TheThreeGoodThings
        -> HaveIdea -> WriteDown (RefactorLater) -> WriteDownMore -> WriteDownAssociations -> WriteDownEvenMoreIfNotStoppedByExternalInfluences
        -> RefactorIdeas -> Categorize -> AddNotes -> AddTasks
        -> DoThings -> ReadTasks -> DoTasks
    -> TheFourthBadThing: TimeTrackAllThis ;-) (it seems to be not so far away....)

o what do we need / what do we do?
    --- researcher
        o OnlineReading
        (o SelectItemsForDownload) <- want-to-have
        (o DownloadItems) <- want-to-have
    --- researcher
        o OfflineReading
        x ClumsyOfflineReading <- status-quo
            (o NiceOfflineReading) <- want-to-have
            (o OfflineArchiving) <- want-to-have
        o OfflineEditing (text, html, pod, tavi)
        o OnlinePublishing ()
    --- engine
        o LiveDispatching (ContentEncoding, ContentConversion, EnvelopeEncapsulation, GatewayToXyz)
            o OfflineRendering (html, text, pdf, chm)
    --- reader
        o OnlineReading ()
        (o SelectItemsForDownload) <- want-to-have
        (o DownloadItems) <- want-to-have
        o OfflineReading (pdf, chm)

o link to http://teamsonar.no-ip.com

o mail announces to announce@netfrag.org

o no symlinks in webroot anymore? use ApacheAliases?

o MiniHowto: NfoLinkageSystem(->news.nfo.announce)
    o this declaration could mean:
        o UseResources:
            o look up "NfoLinkageSystem" as subject in newsgroup "news.nfo.announce" on default newsserver
        o RenderThisWay:
            o embed into document - html3
            o embed into document - dhtml (ExpandTree, CollapseTree)
            o LinkToIt (JumpToMechanism(->minihowto))

o php: appcontrol: reads .appcontrolrc-files recursively from directories and adds/removes users or sets passwords
        according to specification in there

o source-code parser which creates documentation with wiki techniques
    o pod2tavi -> tavi2html
    o phpDoc <- tavi-plugin?

o integrate yakka and newsportal:
    o make a yakka-page of embedded news-articles / threads / thread-parts (a NewsComposition) (->YakkaPageMetadata)
        o article-sources
            o all items from one news-server
            o !!! from different news-servers !!!
        o add a "CommentThis"-links to each item when rendering
        o when user posts the answer on YakkaEditPage
            o make yakka post to the article's associated news-server (read from YakkaItemMetadata)
            o wait until new article is published, then ...
                o ... add to NewsComposition (update YakkaPageMetadata) (->AsynchronousBackendDaemon)
                o ... use/introduce a MetaItem "New" into YakkaPageMetadata (at TopLevel)
                    which shows NewItems(->self, ->live) per thread or newsgroup
      o download this and that - e.g.:
    o phpMyadmin(->archive.software.phpMyAdmin)
        o this requires 'archive.software' to have ...
            o ... a ListSearchHandler (searches nodelist below 'archive.software' only)
            o ... a RecursiveSearchHandler (searches nodelist below 'archive.software' and all subfolders recursively)
            o make this available as a ResourceHandler via a DispatchRequest sitting at
                o http://netfrag.org/archive/?base=software&search=phpMyAdmin
                o http://archive.netfrag.org/

x rename newsgroup nfo.csm to nfo.caesar (Collaborative And Easy System Management)
    x ctlinnd newgroup nfo.caesar
    x /etc/init.d/inn stop
    x cd /var/spool/news/nfo
    x cp csm/* caesar/
    x cd caesar
    (x movearticle ...)
    o chown news.news *
    o /usr/lib/news/bin/makehistory
    x THIS FAILED! DON'T DO IT
      o MiniHowto: KerberizedSystem (->~jonen)

o RefWords -> LookUpDb -> SearchDb

x added first news-article which refers/references to another one in another newsgroup
      Requirement: LDAP For Aliases, Maps, And Classes
      o PARSER-TODO: RefactorThisLink

o check out /usr/sbin/checksecurity - what's that?
    x seems to come from /etc/cron.daily/standard
      o write mail to the KroupwareMailingList

o ContentIndexer for netfrag.org which should provide a FullTextSearch over AllResources

o run MakeDoc at interval at netfrag.org as ServiceUser
    o implement first version of makedoc
    o use mkDoc.bat (or similar) for that purpose
    o extend: use 'makedoc.bat|.pl' from ->cvs.joko.TestArea.topics.authoring.DocBook

o DispatchRequest to tie all together
    o just make a ref from almost everything and see what comes in....
    o write handlers for the various refs....
      o show foldername in CVSSpam - message

o SoWhyCommands?
        o JustUseHumanLanguage!
            o StartWithEnglish
            o TryGerman

o wrappers around the common used cvs commands
    o cvscheckout
    o cvsupdate
    o cvscommit

o newsportal
    feature-idea: crosspost to another group
      o FreeTaskManagement

o run-dotfiles -R fetchdoc|synccvs|makedoc

o netfrag.org: "NewItems" (interacting with user's cookie's)

o phpLdapAdmin
    o use Horde's Ldap-driver!
    o tryout http://www.enaliath.com/phpLDAPadmin.tgz
      o david-addons (Freeware)

o MacOsX (Shareware)

o POE - mailing-list???

o publish all ldap-schemas seperately

o copyright information for nfo/docs/schemas (horde & janosch)

o notify of new news-entries / bug-requests

o scan urls from channel nfo and post to nfo.links.misc

o write current topic of #nfo to some page on http://netfrag.org and link to irc-channel there

o FeatureForTUTOS: ConvertNoteToTask

o FeatureForTUTOS: mark items in MiniTaskView as open or closed (by their respecrive state)

o wiki.de?

o increase memory for quepasa.netfrag.org (128?)

o have a look at /usr/share/mail-audit-tools/popread

o ModeWorkflow:
    o OnlineMode:
        o GoOnline
        o SyncHome2Web
        o BrowseInternet, SelectItemsForDownload (SeeOtherNote "what do we need / what do we do?")
        o SyncWeb2Home
        o GoOffline (switches to DisconnectedMode)
    o DisconnectedMode:
        o ReadMails, WriteMails
        o ReadNews, PostAnswers
        o BrowseIntranet, PublishStuff
        o GoHome (switches to ShutdownMode)
    o ShutdownMode
        o all (important - more or less...) messages are redirected to pre-configured
              addresses and/or notifications are sent on incoming messages at specific
              targets to pre-configured addresses as well.

o Hack: ModifyWord to *only* load and save HTML-Documents

o TUTOS:
    o MyTUTOS:
        o on http://www.netfrag.org/tutos/php/mytutos.php ...
        o "Open Tasks" (below|above "Products & Projects")
        o ... display http://www.netfrag.org/tutos/php/task_overview.php?id=1036
        o columns: Taskname (linked to task), Projectname (linked to project), created
    o Calendar:
        o collapse Items (cut away Project-relationship)
        o limit column width
        o smaller font
        o evtl.: vertically
    o create Task:
        o a "pre"-task doesn't need dates (neither from nor to) (use the creation-date for displaying in overview)
        o an "ongoing"-task needs a begin date only
        o a "finished" task needs both!

o look at docbook.m4 at /home/service/download/mnogosearch/mnogosearch-3.2.7/

o /home/service/download/mnogosearch/3.1.2.5/sample

x all attempts to install some recent mnoGoSearch-version working together with mysql
        from some debian packages failed, now trying mnogosearch-3.1.20
        x configure --with-mysql
        x apt-get install libmysqlclient10-dev
        x configure --with-mysql
        x make && make install
        x configure /usr/local/mnogosearch/etc/indexer.conf
        x cd /home/service/download/mnogosearch/mnogosearch-3.1.20/create/stopwords
            x ./stopword.pl stop.de.txt stop.en.txt > stopwords.txt
            x mysql mnogosearch < stopwords.txt

        x seems to work perfectly with "single"-mode!
                  o now switching to crc-multi again....
            x cd /usr/local/mnogosearch
            x ./sbin/indexer -a -v 5

o phpHtmlLib
    o quick2pick-code: refactor TreeView to *new* phpHtmlLib-component
    o new: add EditingFeature to phpHtmlLib's "InfoTable"-component
    o quick2pick-code: refactor to feature "IntegratedEditing" of phpHtmlLib's "Xyz List" - component

x indexing netfrag.org

    x lookup examples:
        sendmail (->rank!) (exclude http://www.netfrag.org/docs/build/?)
        sync (ok)
        kerberos (exclude http://www.netfrag.org/docs/build/?)
        xabbu (ok)
        polygon (ok)
        textur (ok)
        3d (ok)
        parkvilla (ok)
        stonie (ok)
        lash la rue (ok)
        sendmail (ok)
        kerberos (ok)
              o not needed urls (exclude somehow (mnogosearch-directive|robots.txt!):
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/HowToUseWiki
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/FindPage
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/SandBox
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/WikiWikiWeb
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/RecentChanges
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/AddingPages
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/TextFormattingRules
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/UserPreferences
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PhpWikiDocumentation
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/MoreAboutMechanics
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/EditText
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/WabiSabi
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/RecentVisitors
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/SteveWainstead
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/RecentEdits
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PhpWiki
        (Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/HomePage)???
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/MagicPhpWikiURLs
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/CalendarPlugin
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/GoodStyle
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/InterWiki
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/LinkIcons
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PgsrcTranslation
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PhpWikiAdministration
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/ReleaseNotes
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/WikiPlugin
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/MostPopular
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/InterWikiMap
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/CategoryCategory
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/AllPages
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/BackLinks
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/DebugInfo
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/FullRecentChanges
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/FullTextSearch
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/LikePages
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PageHistory
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/TitleSearch
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/TestPage
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/OrphanedPages
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/FuzzyPages
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/Info
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/NewMarkupTestPage
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PageGroupTest
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PageGroupTestFour
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PageGroupTestOne
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PageGroupTestThree
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/PageGroupTestTwo
        Indexer[23070]: [1] http://www.netfrag.org/nfoweb/index.php/RandomPage
    o ... same with "http://www.netfrag.org/rrr/index.php/" - it's a phpWiki, too
        => make up a robots.txt?
    x exclude http://www.netfrag.org/docs/build/!!!
        x Disallow Regex http://www.netfrag.org/docs/build/.*
    o FeatureRequest: remember (via cookie!) last issued searches
    x how to clear a mnogosearch-index-database?
        x indexer -C
    x how to re-index?
        x just run 'indexer'
    o index more resources on netfrag.org (news, cvs)
    o exclude unwanted resources (wiki-test-& default-pages & co.)
    o establish http://search.netfrag.org/
        o place DispatchRequest there, let it redirect to an application "mnoGoSearch"
        o "mnoGoSearch" is currently installed at http://netfrag.org/search/
        o => (e.g.) http://search.netfrag.org/dust -> http://netfrag.org/search/?q=dust

o http://w-a-c.com: Inhalt unter "Clubtreffen" besser positionieren!

o http://lashlarue.de: inhalte und struktur überarbeiten

x patch cvs-permissions:
    x cd /var/lib/cvs/nfo
    x chown -R .src doc patches perl php
    x chown -R .rootsrc hosts layouts
    o do this regularly
    o run indexer and '.runrc' on interval!

o amo@grasshopper: cleanup local repository 'nfo' from cvs.netfrag.org!!!

o categorization:
    o document-type:
    o file-type:
        o suffix: .xyz (guess application-relationship of file from this)
        o content-encoding: ASCII, EBCDIC, UTF-8, etc.

o shortcut for:
    o ctlinnd newgroup nfo.dev.php
    o nano /data/www/global/apps/newsportal/groups.txt
        add: nfo.dev.php Php Development

o look at slurp:/var/www/docbook-dsssl/

o make ResourceGroups (group - what else? - resources together - from netfrag.org or other urls/urns or WikiTags)

o look at R:\staff\public\Research\Mirrored Sites

o phpw2hfax?

o look at phpOrgaSync: http://www.ds-services.de/portal/
    o ->http://www.phprojekt.com/

o amavis uses 'Net::Server::PreForkSimple':
        Jan 30 07:52:53 quepasa amavis[25445]: 2003/01/30-07:52:53 Amavis (type Net::Server::PreForkSimple) starting! pid(25445)

o mnogosearch: use searchd? what's spelld?

o look at quepasa:/etc/apache/httpd.conf:
    # MetaDir: specifies the name of the directory in which Apache can find
    # meta information files. These files contain additional HTTP headers
    # to include when sending the document
    #
    #MetaDir .web

    #
    # MetaSuffix: specifies the file name suffix for the file containing the
    # meta information.
    #
    #MetaSuffix .meta

o look at quepasa:/etc/apache/httpd.conf:
    # Customizable error response (Apache style)
    # these come in three flavors
    #
    # 1) plain text
    #ErrorDocument 500 "The server made a boo boo.
    # n.b. the (") marks it as text, it does not get output
    #
    # 2) local redirects
    #ErrorDocument 404 /missing.html
    # to redirect to local URL /missing.html
    #ErrorDocument 404 /cgi-bin/missing_handler.pl
    # N.B.: You can redirect to a script or a document using server-side-includes.
    #
    # 3) external redirects
    #ErrorDocument 402 http://some.other_server.com/subscription_info.html
    # N.B.: Many of the environment variables associated with the original
    # request will *not* be available to such a script.

o look at quepasa:/etc/apache/httpd.conf:
    # Allow http put (such as Netscape Gold's publish feature)
    # Use htpasswd to generate /etc/apache/passwd.
    # You must unremark these two lines at the top of this file as well:
    #LoadModule put_module modules/mod_put.so
    #
    #Alias /upload /tmp
    #
    # EnablePut On
    # AuthType Basic
    # AuthName Temporary
    # AuthUserFile /etc/apache/passwd
    # EnableDelete Off
    # umask 007
    #
    # require valid-user
    #

    #


o admin:
    o LoginLists (e.g. User-Account per Service(mail (send & recieve), shell, wiki, news))
    o IncludeLists (e.g. include newsgroup into newsportal (news2http-gateway), include path to Backup)
    o ExcludeLists (e.g. exclude from Indexer (mnoGoSearch))

o a general question: why does a user *still* has to specifiy *two* servers for mail?
    technical - okay (more than....) - but from the user perspective? no! just one!
      o benchmark dispatchmail:
      a) started via pipe in .forward-file
        MTA Queue status...
                                        /var/spool/mqueue (3 requests)
        -----Q-ID----- --Size-- -----Q-Time----- ------------Sender/Recipient-----------
        h0U8ARv9027686* 16930 Thu Jan 30 09:13
                                                                                          
        h0U8ARv7027686* 56 Thu Jan 30 09:13
                                                                                          |"/data/opt/dispatchmail/bin/dispatchm
        h0U8ARv5027686* 56 Thu Jan 30 09:13
                                                                                          |"/data/opt/dispatchmail/bin/dispatchm
                                        Total requests: 3
      b) as milter-handler????

o lookup: paul verilio

o review D:\e\home\amo\develop\cvs\nautilux.progressive-media.de\amo !!!

o make up a Bundle::dispatchmail
    o install dispatchmail
    o get dispatchmail.pl from nfo-repository
        o get Mail::Audit from CPAN
        o get Mail::Audit::Dispatch from nfo-repository
        o get dependencies
            o DesignPattern::Object
            o DesignPattern::Bridge
            o org::netfrag::shortcuts
            o MIME::Lite
            o Hash::Merge
            o Log::Dispatch
            o Log::Dispatch::Config
    o load a sample .dispatchmrc into your users home-directory
    o edit it according your needs - see (in future) Mail::Audit::Tour
    o test your rules by running
        o ./buildmail | ./dispatchmail --base=/home/username (you'll need MIME::Lite for running buildmail...)

o cvshistory
    o draw a graphical / navigatable timeline of a cvs-history
    o embed urls pointing to arbitrary resources

o establish: bugs@netfrag.org
    o automagically create TUTOS-ticket

x groupwares / time-trackers
    x TUTOS
    x phpProjekt
    o [include tool from janosch here]

o get together Log::Dispatch(mail) and Mail::Audit::Dispatch
    o make up a Log::Dispatch::Address
        o use Data::Map(via ldap) to actually resolve

o Torus - client-compatibility
    o Outlook Express, Outlook 2000, 2002 (win32)
    o Horde (web)
    o Netscape & Mozilla (win32 & *nix)
    o Ximian Evolution (*nix)
    o TUTOS (web)
    o Twig (web)
    o PhpProjekt
      o jonen@gharb: patched Mail::Audit::Dispatch (don't ask for ~/Mail any more!)

o glossary: public bulletin board

o dispatchmail: make option "--user=" work again!

  

$Id: joko_2003-01.html,v 1.133 2003/04/05 02:28:18 joko Exp $