--- joko/doc/SampleTasks/joko_2003-01.html 2003/01/23 19:38:19 1.1
+++ joko/doc/SampleTasks/joko_2003-01.html 2003/01/28 07:03:44 1.78
@@ -1,3 +1,40 @@
+
+
+ joko's sample notes - 2003-01 - InventoryCleanupAndRefactoring
+
+
+
+
+
+
+
+
+
+
+AIMS:
+ - Convert this document into a data-structure and back.
+ - Don't loose a bit of information.
+ - Make possible to link to all resources available.
+
+for working with it
+ - global metadata
+ - cvs-loginfo/commitinfo
+ - ItemMetadata
+ - ItemStatus (open, closed and stuff)
+ - ItemAuthor
+ - ItemType
+ - ItemIdentifier
+ - references/associations to/from
+ - word metadata
+ - link to target
+ - show target as ...
+ - overview of all gathered metadata (at the bottom)
+
+for rendering it
+ - render at as [in ] [to this ]
+
+
+
joko@netfrag.org - sample stack:
o [task by joko] introduced "dispatchmail" to add mail2news-functionality to "recieveMail" (collector@netfrag.org)
@@ -29,7 +66,7 @@
x seems to make an external web-based newsreader unneccessary!!!
o tie together mail, news and html
- o write mini-howto
+ c write mini-howto
o link with erfrakon
@@ -60,63 +97,24 @@
o check out from cvs-repository:
o joko/doc -> /home/joko/public_html/computing/overview/topics/
- o leaded to (A):
- o write mini-howto: "howto use, document and enhance the '.cvslink'-symlinking-mechanism"
- o introduce command to 'tiki-workflow|tiki-publish'
- x introduced '.cvs'-interface (directory-style)
- x now directly accessible (but hidden) via http://netfrag.org/~joko/computing/overview/topics/.cvs/
- x here: made public by adding a "README.html" (or "HEADER.html") which either:
- x includes a html-link (a-tag) to './.cvs'
- o makes a redirect via meta-tags or javascript
- o leads to (B):
- o start 'home2web':
- x begin with having an overview of the recent topics stored in cvs
- x continue by expanding this topic-list through more details
- x use mechanisms delivered from Apache
- x HEADER.html, README.html
- x php: http-redirect
- o add more links!
- o fix proposals of how links should be expanded (maybe post RFC to news.netfrag.org first? -> create newsgroup 'nfo.rfc')
- x manually? no! (hmmm, grrrr......)
- o pod? for now!
- o DocBook? not yet!
- o some wiki? why not?
- o add links to internal tools (e.g. TUTOS, chora, etc.)
- o add external links
- o add co-worker topics
- o leads to (C):
- o write mini-howto: web publishing with cvs
- - write in pod
- - commit to cvs
- - checkout from cvs
- - build html from pod
- - publish html
- x do that regularly / in interval: use cron!
- su joko
- cd ~
- nano .cronrc-hourly
- add line(s): [...] cvs update topics [...]
- crontab -e
- add line: * 1 * * * ~/.cronrc-hourly
- o post message "About" (this) to announce@news.netfrag.org
-
-
-adduser: collector/col§$
-
-
-some sample items occoured 2003-01-17 until 2003-01-26.
-
-what to do with that?
- o have all items stored in other applications conveniently.
- o be able to have items or references to them *archived* centrally
- o be able to access informations via *one* interface.
- actually *multiple* interfaces should be possible
- - the aim here is to get everything together (INTEGRATE!) (mnoGoSearch first! Torus::Archive later?)
-
-sysadmin tasks:
+ o leaded to (A, B and C): see home2web
-joko's tasks:
+o added user@netfrag.org:
+ x adduser: collector/col§$
+o about: some sample items occoured 2003-01-17 until 2003-01-26.
+ what to do with that?
+ o have all items stored in other applications conveniently.
+ o be able to have items or references to them *archived* centrally
+ o be able to access informations via *one* interface.
+ actually *multiple* interfaces should be possible
+ - the aim here is to get everything together (INTEGRATE!) (mnoGoSearch first! Torus::Archive later?)
+
+o refactor topics:
+ o make global-accessible@netfrag.org
+ o introduce subtopics
+ o sysadmin tasks
+ o janosch's, jonen's and joko's tasks
o start project "admintools" @ nfo/perl/scripts - including
o getip.pl
@@ -158,3 +156,1024 @@
o rename "thread" to "newsgroup" in all scripts!
+o what about:
+ Torus::Xyz - solution to reuse concepts of Apache 2 and Cyrus 2!!! (and OpenLDAP???) for building an open collaboration server?
+
+o word-search: "identify" and "search" for
+
+o establish global "logs/" - like at http://moose.qx.net/logs/
+
+o add redirecting page when someone wants to access
+ o http://netfrag.org/~joko/phpChoPro/ or
+ o http://netfrag.org/~joko/w2hfax/
+
+o update mail-dispatching-rules - aim: a more flat structure!!!
+ o look at ilo.de/Inbox
+ o marked message to Spam? Newsletters?
+ x move: logs/cvs/quepasa.netfrag.org -> logs/netfrag.org
+ x look at netfrag.org/Inbox
+ x if subject matches "Cron " set target "logs/netfrag.org/joko/cron" [push over cron]
+ x mkdir Mail/SORTED/netfrag.org/joko
+ x touch Mail/SORTED/netfrag.org/joko/cron
+ x if subject matches "quepasa daily usenet report" at begin set target "logs/netfrag.org/system/applications" [push over inn]
+ x if subject matches "[CVS" at begin set target "logs/netfrag.org/cvs" [push over CVSSpam]
+ x if mail is from myself set target "me2myself"
+ x moved some folders
+ x move already existing file to folder
+ x mv logs/netfrag.org/system logs/netfrag.org/system.tmp
+ x mkdir logs/netfrag.org/system
+ x mv logs/netfrag.org/system.tmp logs/netfrag.org/system/applications
+ x mv netfrag.org/Status/h1.service.netfrag.org logs/netfrag.org/system/
+ x mv netfrag.org/Status/TWikiChanges logs/twiki.org/ChangeLog
+ x mkdir logs/twiki.org
+ x do changes in .dispatchmailrc - always - ;-)
+ x mv netfrag.org/Status/quepasa.netfrag.org logs/netfrag.org/system/
+ x blocked email-partition *partition*! - email-partition(!) -> WordFinder
+ x mkdir ../FILTERED
+ x mv netfrag.org/Status/Spam ../FILTERED
+ x mv netfrag.org/Status/Test misc/
+ x mv netfrag.org/Status/Postmaster\ Routing misc/Postmaster
+ x rmdir netfrag.org/Status/
+ x look at netfrag.org/Inbox - again
+
+
+ o look at quepasa.netfrag.org/Inbox
+ o [Multisync-users]
+ o [Kroupware]
+ x tested the rules from above
+ x echo This is a testmail. Please ignore it. | mail -s "[CVS hello]" joko
+o move old mails to MailHistory
+
+ o write parser and engine to handle above declaration: Mail::Audit::Dispatch::Interface::Script
+ o add "X-"-field (X-Dispatched-By: dispatchmail-0.06 - http://netfrag.org/~joko/computing/dispatchmail/)
+
+o release mail from above from joko - introduce another email-address
+ - e.g. work@netfrag.org, event@netfrag.org or tracker@netfrag.org (like collector@netfrag.org)
+
+o Multisync & SyncML
+ o post something to mailing-list...!?
+
+o the '.cvslink'-mechanism:
+ o type: ln -s /home/joko/public_html/_web/_cvs.php .
+
+o LinkContainer
+ - insert via drag & drop
+ - shows links hierarchically
+
+o (Self)Info - mails to yourself
+ o convert all "(Self)Info" mails to
+ news-messages - use "formail" and ...?
+
+o h1.service.netfrag.org
+ o base os-upgrade: suse X -> debian 3.0
+
+o dispatchmail
+ o are Mail-Headers already added?
+
+o workflow (PostThisLink)
+ o drag link from done google-search ...
+ o ... to container (at the current Task)
+ o a news-post is created automagically
+ o use this:
+ [smtp-header-fields]
+ From: expanded email-address resolved from Name|Nickname in Addressbook (via LDAP!)
+ Subject: googled for ""
+ [body]
+ o include into mime-part if not already included
+ o fetch from web on demand
+
+o ssl/tls for inn?
+
+o dispatchmail
+ o re-link as sub-/module-project under Torus::Content::Gateway (mail2news, mail2fax)
+ o -> Torus::Content - a content delivery engine
+ o -> additional idea: Torus::Content::Gateway is "just" the API to "Torus::Item::Router" in this case
+ o 'Torus::Content::Gateway' would then route 'Torus::Item::RFC822'-objects using 'Torus::Item::Router'
+ o look at sieve - jonen posted to nfo.links.computing: [r:Message-ID: ]
+ o re-link as sub-/module-project under Torus::Virtual (mail2folder, mail2mail)
+ o here it acts as a dispatcher from incoming mails - TARGET gets resolved via ldap-resolvement
+ o make possible: MAIL-IN -> mail2mail (via ldap-query) -> mail2fax|mail2news
+ o mail2news
+ x the "via-fetchmail"-solution
+ x su collector
+ x cd ~
+ x chmod og-rwx .fetchmailrc
+
+o finally: do actually establish 'Torus' at 'nfo/perl/libs'
+
+o pod: checkout how to make references which expand to html-urls
+ o does pod handle this or do we need external link-expansion for this task?
+ o how to make references to news-messages?
+ e.g.:
+ o Message-ID:
+ o news://news.netfrag.org/nfo.links.computing
+ o proposal(s) for "news2http" (Torus::Content::Gateway/Torus::Item::???):
+ o http://news.netfrag.org/id=b0ppj7$7gv$1@quepasa.netfrag.org
+ o http://news.netfrag.org/nfo.links.computing/subject=FilteringMailWithSieve of wiki
+ o http://news.netfrag.org/nfo.links.computing/id=b0ppj7$7gv$1@quepasa.netfrag.org
+
+o what about the '.nws'-files on ms? (for news-messages)
+
+o display-mode: everything strictly hierarchical to get maximum overview!!!
+
+x Inventory: cleaned up local and master code repositories
+
+o add "last-updated" to "README.html"
+
+o search.netfrag.org
+
+o tool for the "DoThis", "DoHere", "DoAll" - series
+ o FaxThis (joko/ToolBox/Windows/FaxThis)
+ o tool "WinSync": (WinSync All)
+ x RsyncHere
+ o Contacts2Ldap
+
+o statistics-page:
+ o for cvs.netfrag.org: cvs-statistics (activeness, ...), sloccount
+
+x home2web
+ x finally - added complete /home/joko/ to cvs-repository in order to get a revisioned ".dispatchmailrc"
+ x ~/.bashrc - added line: export CVSROOT=/var/lib/cvs
+ x relogin: logout/login
+ x cd ~
+ x joko@quepasa:~$ cvs checkout -d . joko (Fri Jan 24 00:43:18 CET 2003)
+ x cvs add TODO
+ x cvs add .bashrc .cronrc-hourly .forward
+ x added /home/joko/virtual/joko_mail
+ [as joko]
+ x cvs add virtual
+ x chmod g+w virtual/CVS/*
+ [as joko_mail
+ o shortcut for (e.g.): cvs commit -m "initial check-in" .bashrc .cronrc-hourly .forward
+ o cvsadd
+ o add /home/root (and maybe include there some other things "lying around")
+
+o alternative to all that Cyrus-stuff: just use the very "normal" imapd together with kerberos
+
+o make screenshots of log-output of dispatchmail when it's ready
+
+o base logging of 'dispatchmail' on DesignPattern::Object::Logger
+
+o dispatchmail-mail2folder: add feature to create folders recursively
+
+x archive mails
+ x su joko_mail
+ x cd ~
+ x mv ilo.de/Inbox ~/MailHistory/ARCHIVED/ilo.de/2002-05-30\ -\ 2003-01-24
+ x mkdir ~/MailHistory/ARCHIVED/netfrag.org/2003-01
+ x mv netfrag.org/Info ~/MailHistory/ARCHIVED/netfrag.org/2003-01/
+ x changed rule which formerly targeted to 'netfrag.org/Info' into 'me2myself'
+ x mv netfrag.org/Inbox ~/MailHistory/ARCHIVED/netfrag.org/2003-01/
+ x mkdir ~/MailHistory/ARCHIVED/netfrag.org/2003-01/Status
+ x mv netfrag.org/Status/cashew.netfrag.org ~/MailHistory/ARCHIVED/netfrag.org/2003-01/Status/
+ x mv netfrag.org/Status/h1.service.netfrag.org ~/MailHistory/ARCHIVED/netfrag.org/2003-01/Status/
+ x mv Sent ~/MailHistory/ARCHIVED/Sent/Sent_2002-11-13_-_2003-01-24
+
+
+o investigate LDAP-entry "mailForwardingAddress"
+
+o establish "Mini-HowTo"
+
+o search (allover): /^.*\.netfrag\.org/ => find all hostnames to register
+ (they are scattered around in to-be-installed (web-)applications)
+
+o Mail::Audit::Dispatch::Lookup (csv-file, ::NetLDAP, => Data::Storage::Handler::Xyz => Data::Map)
+
+x switched mailing completely in outlook
+ o Evolution!
+ x now talking to 'wu-imapd' via ssl, too! - thanks to jonen!
+ Jan 24 04:55:17 quepasa imapd[11508]: connect from 217.231.123.57
+ Jan 24 04:55:17 quepasa imapd[11508]: imaps SSL service init from 217.231.123.57
+ Jan 24 04:55:18 quepasa imapd[11508]: Login user=joko_mail host=pD9E77B39.dip.t-dialin.net [217.231.123.57]
+ x now my outlook sends via 'mail.netfrag.org' using 'TLS' - thanks to jonen!
+ Jan 24 04:53:09 quepasa sm-mta[11499]: STARTTLS=server, relay=pD9E77B39.dip.t-dialin.net [217.231.123.57], version=TLSv1/SSLv3, verify=NO, cipher=RC4-MD5, bits=128/128
+ Jan 24 04:53:10 quepasa sm-mta[11499]: h0O3r91D011499: from=, size=435, class=0, nrcpts=1, msgid=<008c01c2c35c$5701d2a0$240aa8c0@grasshopper>, proto=ESMTP, daemon=MTA, relay=pD9E77B39.dip.t-dialin.net [217.231.123.57]
+
+o use IMAPFilter!!!
+
+o refactor old TODOs using 'home2web'
+
+o webgate (like dispatchmail)
+
+o zeit anhalten! (alle grauen männer umbringen!)
+
+o add to cvs:
+ o /home/service/
+ o /home/service/virtual/collector
+ o /home/service/virtual/tracker
+ o /home/service/virtual/fetcher
+ o /home/service/virtual/archiver
+
+o use 'wCron' to automagically do a 'cvs commit -m "+ updated/added content" joko/doc'
+ x mkdir -p C:\Programme\WCron
+ x unzip -j "C:\home\amo\develop\netfrag.org\rabit\wCron\releases\WCron-0.62-pre.zip" -d C:\Programme\WCron
+ o win2000: change/check permissions: right-click/Properties/Security Settings/Read, Execute = enabled
+ x run it
+ x add task
+ x implement shortcut-script: joko/Scripts/shortcuts/cvs_commit_joko-doc.bat
+ x add lines:
+ x cd C:\home\amo\develop\netfrag.org\joko
+ x cvs commit -m "+ updated/added content" doc
+
+
+o on Windows it's called "QuickLaunch" ....
+
+o plugins for nautilus/gnome/kde:
+ show arbitrary data-structures (from anywhere): here we may get the drag & drop - functionality "on-the-fly"
+
+o new user "gateway":
+ x adduser --home /home/service/virtual/gateway gateway (pass: gw%R%)
+ x mkdir /var/lib/cvs/gateway
+ x chown -R gateway.gateway /var/lib/cvs/gateway
+ x su gateway
+ x cvs -d /var/lib/cvs checkout -d ~ gateway
+
+x error on quepasa:
+ Jan 24 19:00:09 quepasa sm-mta[17960]: STARTTLS=server, relay=pD9E77B39.dip.t-dialin.net [217.231.123.57], version=TLSv1/SSLv3, verify=NO, cipher=RC4-MD5, bits=128/128
+ Jan 24 19:00:09 quepasa sm-mta[17960]: h0OI081D017960: ruleset=check_rcpt, arg1=, relay=pD9E77B39.dip.t-dialin.net [217.231.123.57], reject=550 5.7.1 ... Relaying denied. Proper authentication required.
+ x add to /etc/mail/default-auth-info
+ sendmail
+ sendmail
+ sendmailpwd
+ quepasa.netfrag.org
+ x /etc/init.d/sendmail restart
+
+o Torus::Publish::Research::Web
+ o googling for something automagically opens a new task
+ o all links directly or indirectly coming out of this are sorted below this task
+ o the user can end this task on demand: timetracking is done automagically as well
+
+o register tutos.netfrag.org
+
+o qpopper with tls, sasl and kerberos5?
+
+o off realtime! the only thing that happens at realtime is MailMiltering.
+ x cvs checkout of joko/doc is done via cron
+ x mail2news-dispatching is now done via cron (would be possible "in realtime" via '.forward'ing the mail *directly* to dispatchmail)
+
+o ctlinnd newgroup nfo.csm (Collaborative System Management)
+
+o make possible:
+ o after "cvs update" make question: "Found new items in "" while scanning. Should i add them to the repository?"
+ o drag & drop arbitrary items out of outlook (.msg, .nws, etc.) - search for them while scanning the fs and sync them
+ against *original* source. (e.g. 'Message-ID: ')
+
+x CVSSpam -> nfo.log.cvs
+ x su root
+ x cd /etc/mail
+ x nano virtusertable
+ x add line:
+ x cvs-log@netfrag.org gateway
+ x make virtusertable
+ x su gateway
+ x cd ~
+ x nano .dispatchmailrc
+ x add lines:
+ $self->copy('Newsgate', 'nfo.log.cvs')
+ if $to =~ m/cvs-log/;
+ x exit (to logout)
+ x cvs update CVSROOT/loginfo
+ x add to CVSROOT/loginfo (to the end of the line starting with '^nfo '):
+ --to cvs-log@netfrag.org
+ x cvs commit -m "+ added new notification target: 'cvs-log@netfrag.org'" CVSROOT/loginfo
+ x tested with some mini-howto
+ x removed '--to joko@netfrag.org --to jonen@netfrag.org --to bareface@netfrag.org --to janosch@netfrag.org '
+ from CVSROOT/loginfo for module 'nfo'
+ x announce this
+ x added to '/etc/news/nnrp.access':
+ *:Read Post:bareface:bareface:*
+ x /etc/init.d/inn reload
+
+x add 'gateways'-repository to chora
+ x nano /data/www/doc/horde/chora/config/cvsroots.php
+ x add lines:
+ # 2003-01-24, joko
+ $cvsroots['gateway'] = array(
+ 'name' => 'gateway',
+ 'location' => '/var/lib/cvs/gateway',
+ 'title' => "$titlePrefix gateway's CVS Repository",
+ 'cvsusers' => $cvsusers,
+ );
+
+x configured Apache for serving news.netfrag.org
+ x cleaned up /data/www/virtual/netfrag/conf/httpd.conf
+ x ./test.conf
+ x comments
+ x /etc/init.d/apache reload
+ x test: http://news.netfrag.org/
+
+o new module for cvs-repository?
+ o nfo/layouts/fs/skel/data2
+ o checkout to /data on quepasa.netfrag.org
+ x done:
+ x su root
+ x cd /var/lib/cvs
+ x mkdir -p nfo/layouts/fs/skel/data
+ x mkdir -p nfo/layouts/fs/skel/data2
+ x mkdir -p nfo/hosts/quepasa.netfrag.org/data
+ x cvs -d /var/lib/cvs checkout -d /data nfo/hosts/quepasa.netfrag.org/data
+ x *mungle everything and commit!* look at the repository!
+ x add special group with access to this repository: 'rootsrc'
+ x groupadd rootsrc
+ x usermod -G src,staff,rootsrc joko
+ x usermod -G src,staff,rootsrc jonen
+ x usermod -G rootsrc root
+ x change permissions
+ x cd /var/lib/cvs/nfo/
+ x chown -R .rootsrc hosts
+ x chmod -R g+w hosts
+
+
+x add to system-conf-repository:
+ x /etc/mail
+ x php: cvs-redirect
+ x
+
+o extend WCron
+ x show (per-task) if it's currently running or not: provide buttons to (start, stop, pause, resume or cancel a task...)
+ x use as a frontend for administering nfo/libs/perl/ - backend - tasks(???)
+
+x install Horde/Troll
+ x install troll
+ x cd /home/service/download
+ x mkdir horde
+ x cd horde
+ x wget ftp://ftp.horde.org/pub/troll/troll-0.0.2.tar.gz
+ x tar -xzf troll-0.0.2.tar.gz --directory=/data/www/doc/horde/
+ x configure horde
+ x cd /data/www/doc/horde/
+ x nano config/registry.php
+ x add lines:
+ $this->applications['troll'] = array(
+ 'fileroot' => dirname(__FILE__) . '/../troll',
+ 'webroot' => $this->applications['horde']['webroot'] . '/troll',
+ 'icon' => $this->applications['horde']['webroot'] . '/troll/graphics/troll.gif',
+ 'name' => _("News"),
+ 'allow_guests' => true,
+ 'show' => true
+ );
+ x configure Troll
+ x cd troll/config
+ x conf.php
+ x cp conf.php.dist conf.php
+ x nano conf.php
+ x edit:
+ x $conf['news']['server'] = 'news.netfrag.org';
+ x $conf['news']['mailserver'] = 'mail.netfrag.org';
+ x servers.php
+ x cp servers.php.dist servers.php
+ x add:
+ $servers['netfrag.org'] = array(
+ 'name' => 'news.netfrag.org',
+ 'server' => 'news.netfrag.org',
+ 'port' => 119,
+ );
+ x prefs.php
+ x cp prefs.php.dist prefs.php
+ x html.php
+ x cp html.php.dist html.php
+ x permissions
+ x chmod o+r *.php
+
+
+ x test: http://netfrag.org/horde/
+ o another (more bright) skin for horde@netfrag.org!!!
+
+o Warum nicht überall Horde? Sondern TUTOS?
+ o Horde ist sehr breit angelegt, dafür fehlt es jedoch an vielen Stellen noch ein wenig im Detail.
+ o mittlerweile: mit Hermes & Co.? nochmal ansehen!
+
+o just do automated operations (like cvs commit) only if system is idle
+
+o automagically redirect http://netfrag.org/horde/ to https://netfrag.org/horde/
+ o with an Apache - rewrite-rule?
+
+x how to map TUTOS-groups to newsgroups?
+ x ctlinnd newgroup nfo.tutos.sysadmin
+ x add dispatching for sysadmin@netfrag.org
+ x add to /home/service/virtual/gateway/.dispatchmailrc
+ $self->copy('Newsgate', 'nfo.tutos.sysadmin') if $to =~ m/sysadmin/;
+ x add to /etc/mail/virtusertable:
+ # --- news.netfrag.org - joko, 2003-01-24
+ sysadmin@netfrag.org gateway
+ make virtusertable!
+ x write welcome-mail
+ root@quepasa:~$ mail sysadmin@netfrag.org
+ Subject: Welcome to the sysadmin-newsgroup at netfrag.org!
+ Have fun!
+ greets, joko.
+
+ .
+ Cc:
+ x test: do "refresh newsgroups" at your favourite news-reader
+ x this has been refactored to: [news:id=b0shbj$l9s$1@quepasa.netfrag.org]
+ x HEADERS:
+ x Message-ID:
+ x Subject: Re: Welcome to the sysadmin-newsgroup at netfrag.org!
+ o newsgate
+ o http://news.netfrag.org/nfo.tutos.sysadmin/id/b0shbj$l9s$1@quepasa.netfrag.org
+ o http://news.netfrag.org/nfo.tutos.sysadmin/subject/Re: Welcome to the sysadmin-newsgroup at netfrag.org!
+
+o Erkenntnis aus UML (Kernel 2.4): schwierig mit gleichzeitigem Zugriff
+
+o gave up trying to get Troll running
+
+x setup alternatives to Horde for public access
+ o viewcvs
+ x apt-get install libapache-mod-python
+
+ o WebNewsViewer
+
+o release the user from having to send email-messages to actually post urls with content (e.g. "FirstPage")
+
+o parse .url-files!
+
+o have newsgroup-structure backed in ldap-container (ou) somehow (Data::Map!)
+
+x new email-addresses@netfrag.org:
+ x sysadmin@netfrag.org
+ x faq@netfrag.org
+
+x --rework|*reworked*-- apache-layout - check into repository as something root is responsible for!
+
+x --setup|*setting up*-- newsportal (by Florian Amrhein)
+ x url: http://florian-amrhein.de/newsportal/
+ x cd /home/service/download
+ x mkdir newsportal
+ x cd newsportal
+ x wget http://florian-amrhein.de/newsportal/download/newsportal-0.24.tar.gz
+ x mkdir -p /data/www/virtual/netfrag/sites/news/apps/newsportal/
+ x tar -xzf newsportal-0.24.tar.gz --directory=/data/www/global/apps/newsportal/
+ x add to /data/www/virtual/netfrag/conf/applications.conf
+ Alias /webnews/ /data/www/global/apps/newsportal/
+ x configure in /data/www/global/apps/newsportal/config.inc
+ // newsserver setup
+ $server="news.netfrag.org";
+ $server_auth_user="webnews";
+ $server_auth_pass="web123";
+ x add to /etc/news/nnrp.access:
+ # 2003-01-26, joko
+ *:Read Post:webnews:web123:*
+ x modify groups.txt
+
+ o TODO: AUTOUPDATE here!
+ x add to the index-page:
+ xR set INSERTION=""
+ x grep -rin "
+ doc/faq.html:4:
+ doc/history.txt:234:- fehlender Tag ergaenzt
+ doc/readme-english.html:4:
+ doc/history.txt~:233:- fehlender Tag ergaenzt
+ extras/frames/thread_frameset.php:10:
+ head.inc:5:
+ x cvs add head.inc
+ x cvs commit -m "+ initial commit" head.inc
+ x
+ x nano head.inc
+ x STRG+W + T: 5
+ xR
+ xR
+ x STRG+O + [ENTER]
+ x test: http://www.netfrag.org/webnews/>
+ o TODO: RefactorThisHtmlRef to WebNews
+ o view message in some MimeViewer or HtmlViewer (Horde?)
+ o -> use a MessageViewer with MimeCapabilities and HtmlCapabilities
+ x Why newsportal and no other?
+ x directly connects to nntp-daemon
+ x has local spool (o TODO: purge regularly?)
+ x highly customizable
+ x added custom css-stylesheet and changed something at content-rendering-level without any problems
+ x visit cvs.netfrag.org to look at the changes made to the newsportal codebase:
+ x -> newsportal at cvs.netfrag.org
+ o TODO: RefactorThisLink
+ x it's just easy!
+ x setup dispatchrequest for http://news.netfrag.org
+ x cd /data/www/virtual/netfrag/sites/news/
+ x create symlink
+ x ./.symlinkrc
+ x copy over from webcvs
+ x cp ../webcvs/index.php .
+ x mkdir .dispatch
+ x cd .dispatch
+ x cp ../webcvs/.dispatch/config.php .
+ x cp ../webcvs/.dispatch/index.php .
+ x cvs add ...
+ x cvs commit ...
+ x added|*adding* dispatcher at http://news.netfrag.org
+ x used and mungled DispatchRequest(->cvs, ->doc, ->search) for this purpose
+ o IdeaFor ParseDoc: expand: cvs=JumpToCvs, doc=JumpToDoc, search=SearchFor
+ x examples for the JumpToCvs mechanism are shown on dev@netfrag.org
+ x no forbidden modules (do this via unix permissions!)
+ x allow tarball generation? yes!
+ x Hint: add "Alias /viewcvs/ /usr/share/viewcvs/" to /etc/apache/conf/httpd.conf for online documents and icons
+ x added to '/data/www/virtual/netfrag/conf/applications.conf' in our case
+ x added '' to '/etc/viewcvs/templates/header.ezt'
+
+o rendering *proposals* for TaviWorkflow
+ o Linking|Referencing (WikiWords, PureExplicitLinkExtrapolation, NamedLinks)
+ o Coloring
+ o [o=red, x=green, R=red, r=green]
+
+o *shortcut*: TestApache to run 'apachectl configtest' (WikiForSystemAdministration)
+
+x web-based newsreader? twig!
+ x apt-get install twig
+
+o shutdown horde (for now: "pause")
+
+o viewcvs & apache-mod-python?
+
+o home2web, .home2webrc
+ o what?
+ --before: buildhtml --source=pod|tavi
+ --after: say "ready"
+ o hmmm...
+ o buildhtml: automate various SubTasks
+ o synccvs (->cvs.nfo.perl.scripts.shortcuts.synccvs.pl)
+ o buildhtml (->makedoc) (->cvs.nfo.perl.scripts.shortcuts.synccvs.pl)
+
+x added root of quepasa to cvs
+ x su root
+ x cd /var/lib/cvs/nfo/hosts/quepasa.netfrag.org
+ x mkdir root
+ x chown -R .rootsrc root/
+ x chmod -R g+w root/
+ x cd /tmp
+ x cvs -d /var/lib/cvs checkout -d / nfo/hosts/quepasa.netfrag.org/root
+ x start with /etc
+ x cd /etc
+ x cvs add etc
+ x cvs add viewcvs
+ x cd viewcvs
+ x cvs add ....
+ x cvs commit -m "+ initial commit"
+
+x How to get a single file from cvs for download: (e.g.)
+ wget http://cvs.sourceforge.net/cgi-bin/viewcvs.cgi/*checkout*/viewcvs/viewcvs/templates/header.ezt?rev=1.2
+
+x cvsgraph still missing: apt-get install cvsgraph
+
+x chora -> viewcvs
+ o change logo at /usr/share/viewcvs/images
+ x removed from template
+ x cvsview-query.cgi didn't work yet!
+ x error was:
+ x tail -f /data/www/virtual/netfrag/log/error_log
+ Traceback (most recent call last):
+ File "/usr/lib/cgi-bin/viewcvs-query.cgi", line 50, in ?
+ import query
+ File "/usr/lib/python2.1/viewcvs/query.py", line 42, in ?
+ import cvsdb
+ File "/usr/lib/python2.1/viewcvs/cvsdb.py", line 34, in ?
+ import dbi
+ File "/usr/lib/python2.1/viewcvs/dbi.py", line 17, in ?
+ import MySQLdb
+ ImportError: No module named MySQLdb
+ [Sat Jan 25 11:16:55 2003] [error] [client 217.231.127.85] Premature end of script headers: /usr/lib/cgi-bin/viewcvs-query.cgi
+ x solution is:
+ x apt-get install python-mysqldb
+ x use mysql;
+ x insert into db values ('localhost', 'ViewCVS', 'viewcvs', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
+ x insert into db values ('%', 'ViewCVS', 'viewcvs', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
+ x insert into user (host, user, password) values ('localhost', 'viewcvs', password('viewcvs'));
+ x flush privileges;
+ x cd /usr/lib/viewcvs
+ x ./make-database
+ x
+ o mail to author of viewcvs
+
+
+o docu about uml and filesystem-layer running on gharb for MiniHowTo?
+
+o search.php?wiki=1&cvs=1&index=1
+
+o get mnoGoSearch running
+ e apt-get install mnoGoSearch
+
+o it's not tavi nor tavi-workflow - it's: JustWrite? it's todo! (.todo -> .justdo -> .justwrite -> .done)
+
+o ScanToWeb
+
+o look at Mailman: http://www.list.org/features.html
+
+o use cvsup!?
+
+o alien.netfrag.org - (package-conversion) --> alien.packages.netfrag.org
+
+o chora2viewcvs - How to migrate from Horde/Chora to viewcvs.
+
+o LinuxInCvs (linux2cvs)
+
+o TestApacheConfig, StopApache, StartApache have to work without any running Apache - of course!
+
+o through "viewcvs" we loose the ability to "publish" documents via former chora:
+ viewcvs takes care to keep documents like they are in their original - so ".html"-files should be shown with text/plain
+
+o re-integrate .cvslink/JumpToCvs with dispatchurl
+
+o WikiWords in CvsCommitMessages? (via yakka?)
+
+x http://cvs.netfrag.org/bareface/yakka/?tarball=1
+
+o [source:/link/to/source-code] (most times a '.cvslink' - hmmm?)
+ [source:]
+
+o HelpMe
+
+o [snapshot:/link/to/snapshot]
+ [snapshot:]
+
+o dispatchrequest - a multipurpose request dispatcher
+ o integrate:
+ x redirector at cvs.netfrag.org ...
+ o ... and news.netfrag.org
+ o JumpToCvs (.cvslink-mechanism)
+ o how was it done?
+ x cd /data/www/virtual/netfrag/sites/webcvs/.dispatch
+ x ln -s /data/www/global/apps/dispatchrequest .
+
+
+o buildhtml -> makedoc
+
+o TWIG & yakka?
+
+o rename: dispatchmail -> dispatchmessage
+
+c rename: dispatchrequest -> forwardrequest?
+
+o readrc of bashrc|perlrc|xmlrc
+
+x setup TWIG
+ x cd /usr/share/doc/twig
+ x cd /data/www/virtual/netfrag/conf/
+ x nano applications.conf
+ x add line: Alias /twig/ /usr/share/twig/
+ x had to modify /etc/apache/conf/httpd.conf:
+ x added: 'index.php3'
+
+ DirectoryIndex index.html index.htm index.shtml index.cgi index.php index.php3
+
+ x added: '.php3'
+ AddType application/x-httpd-php .php .php3
+ x /etc/init.d/apache reload
+ x cd /etc/twig
+ x modify config.inc.php3
+ x cd /usr/share/twig/setup
+ x mysql
+ x use mysql
+ x insert into user (host, user, password) values ('localhost', 'www-data', password(''));
+ x insert into db values ('localhost', 'twig', 'www-data', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
+ x create database twig;
+ x flush privileges;
+ x database-schema
+ x gunzip twig.table.mysql.gz
+ x mysql twig < twig.table.mysql
+
+x setup arbitrary packet and bind to csm-system (Collaborative Software Management)
+ x pinstall twig
+ x apt-get install twig
+ x cd /etc
+ x cvs add twig
+ x cd twig
+ x cvs add *
+ x cvs add .htaccess
+ x cvs commit -m "+ initial commit"
+
+
+o remove html from phpWiki: ('http://'!!!) (->https!!!)
+
+
+
+
+o force https for: (authentication purposes - anonymous is http!)
+ o horde
+ o tutos
+
+x dpkg -x twig_2.7.5-4_all.deb tmp/
+
+o TWIG & OpenLDAP!?
+
+x ApacheMasterLayoutRefactoring: quepasa.netfrag.org:
+ x removed /data/www/doc to /data/www/global/apps
+ x test:
+ x cd /data/www/virtual
+ x grep -ri "/data/www/doc" *
+ x cd /data/www/global
+ x grep -ri "/data/www/doc" *
+ x apps/twiki/
+ x lib/TWiki.cfg
+ x bin/.htaccess
+ x conf/twiki-httpd
+ ---> just change between 'global' and (e.g.) 'virtual/netfrag' for switching between scopes ;-)
+ ---> the container (folder)-structure at global and sub-virtual level must match almost exactly to make this possible!!!!!
+ x conf/virtualdomains-httpd/
+ x doc/twiki/
+ x removed: /data/www/virtual/netfrag/pub to /data/www/virtual/netfrag/sites/public
+ x cd virtual/netfrag/conf
+ x grep -ri "/pub" *
+ x modify httpd.conf and applications.conf
+ x apachectl configtest
+ Syntax error on line 345 of /etc/apache/httpd.conf:
+ DocumentRoot must be a directory
+ x disabled there completely
+ x now in /data/www/global/conf/httpd.conf
+ DocumentRoot /data/www/virtual/netfrag/sites/public
+ x apachectl configtest
+ fopen: No such file or directory
+ apache: could not open document config file /data/www/conf/twiki-httpd.conf
+ x mv /data/www/global/conf/twiki-httpd.conf /data/www/virtual/netfrag/conf/
+ x nano /data/www/virtual/netfrag/conf/applications.conf to match new path
+ x apachectl configtest
+ fopen: No such file or directory
+ apache: could not open document config file /data/www/conf/tutos-httpd.conf
+ x cd virtual/netfrag
+ x grep -rin "www/conf" *
+ x edit applications.conf:21
+ x was: Include /data/www/conf/tutos-httpd.conf
+ x is: Include /data/www/global/conf/tutos-httpd.conf
+ x apachectl configtest
+ Warning: DocumentRoot [/data/www/virtual/netfrag/sites/webnews] does not exist
+ fopen: No such file or directory
+ apache: could not open document config file /data/www/conf/dynamic.conf
+ x grep -rin webnews *
+ x edit applications.conf:30
+ x was: Alias /webnews/ /data/www/global/apps/newsportal/
+ x is: Alias /webnews/ /data/www/global/apps/newsportal/
+ x edit httpd.conf:74
+ x was: DocumentRoot /data/www/virtual/netfrag/sites/webnews
+ x is: DocumentRoot /data/www/virtual/netfrag/sites/news
+ x cd global/conf
+ x grep -rin www/conf *
+ x STDOUT-PARSE:
+ httpd.conf:14:#Include /data/www/conf/httpd-php-perl.conf
+ httpd.conf:16:#Include /data/www/conf/virtualdomains-httpd.conf
+ httpd.conf:29:Include /data/www/conf/dynamic.conf
+ ->FILE-MODIFY: httpd.conf:29:Include /data/www/global/conf/dynamic.conf
+ x apachectl configtest
+ root@quepasa:/data/www/global/conf# apachectl configtest
+ configuring dynamic domain "golf5.de"
+ configuring dynamic domain "smartmen.de"
+ configuring dynamic domain "ballonflug.de"
+ Syntax OK
+ x /etc/init.d/apache restart
+ x testing "http://netfrag.org/" fails
+ x testing "http://netfrag.org/index.php"
+ x makes redirect to "http://netfrag.org/nfoweb/" but fails there
+ x tail -f tail -f /data/www/virtual/netfrag/log/error_log
+ [Sun Jan 26 15:32:04 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/
+ [Sun Jan 26 15:33:02 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/
+ [Sun Jan 26 16:37:37 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
+ [Sun Jan 26 16:38:08 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
+ [Sun Jan 26 16:40:10 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
+
+
+o register:
+ public.netfrag.org -> http://netfrag.org
+ secure.netfrag.org -> https://netfrag.org
+
+o netfrag.org: DispatchRequest for http://netfrag.org/nfoweb/!
+o netfrag.org: DispatchRequest for http://netfrag.org/rrr/!
+
+o IntroduceMergePoint at http://netfrag.org/doc/
+ o MiniHowto
+ o faqs (e.g. from news://news.netfrag.org/nfo.faq.users
+
+o what about an "AUTOSAVE"-feature for UltraEdit when leaving the window or
+ o an AUTOCOMMIT on that very event (maybe integrated with a counter)
+
+o write scripts to iterate recursively through directories under specified path ...
+ o ... and do some actions on each directory, e.g.
+ o execute some specified .dot-files (e.g. .pod2htmlrc, .symlinkrc, .makedocrc)
+
+x CVSSpam in action:
+ 10146 ? S 0:00 /usr/sbin/sshd
+ 10148 ? S 0:00 /usr/sbin/sshd
+ 10149 ? S 0:00 cvs server
+ 10150 ? S 0:00 cvs server
+ 10151 ? S 0:00 /bin/login
+ 10155 ? S 0:00 /usr/bin/ruby -w /var/lib/cvs/CVSROOT/collect_diffs.rb --to joko@netfrag
+ 10158 ? S 0:00 /usr/bin/ruby /var/lib/cvs/CVSROOT/cvsspam.rb /tmp/#cvs.loginfo.10149.10
+
+x as Chora'sStylesheet has come active (by accident) when viewing this file view web
+ we should include this as a fixed default making horde our default stylesheet delivery engine (for now)
+
+o link-checker for netfrag.org
+
+o dispatcher for style.netfrag.org redirecting to ?
+ o styleme.php
+ o brandme.php
+
+
+
+o mini-howto: "HttpRedirect"
+
+o how to refactor the MiniHowtos?
+ o into a wiki? wikis seem to miss offline/distributed capabilities! (for now)
+ x into pod
+ x build offline
+ o build online
+ o into DocBook?
+ o into tavi? (or "TaviWorkflow"?)
+ o but: LinkWithWikiAutomagically to get everything together
+ o look at the InterwikiMechanism
+ o look at the various WikiPluginArchitectures
+ o look at YakkaDev!
+
+o a LinkageExample: RenderThis(html4|text|html3|pdf) with [[yakka]] and [[tavi-workflow]]!
+ o this could mean:
+ o use the declared formats as output filters for viewing target in other formats / styles
+
+o proposal for hierarchical structure (and HomePage) of netfrag.org
+ ~overview -> SomeWiki -> Overview
+ ~projects (include some common text here)
+ ~users (include some common text here)
+ - Page: UserArea
+ - Page: ~users
+ ~projects -> SomeWiki-> Projects
+ ~users (include former page "User area" (now UserArea) automagically at the bottom here! (WikiInclude?))
+ ~rabit (raBit's router - psl.no-ip.com)
+ ~natraj (sam's place - optix)
+ ~joko (joko's)
+ ~bareface (->yakka)
+
+o MasterWorkflow:
+ -> TheThreeGoodThings
+ -> HaveIdea -> WriteDown (RefactorLater) -> WriteDownMore -> WriteDownAssociations -> WriteDownEvenMoreIfNotStoppedByExternalInfluences
+ -> RefactorIdeas -> Categorize -> AddNotes -> AddTasks
+ -> DoThings -> ReadTasks -> DoTasks
+ -> TheFourthBadThing: TimeTrackAllThis ;-) (it seems to be not so far away....)
+
+o what do we need / what do we do?
+ --- researcher
+ o OnlineReading
+ (o SelectItemsForDownload) <- want-to-have
+ (o DownloadItems) <- want-to-have
+ --- researcher
+ o OfflineReading
+ x ClumsyOfflineReading <- status-quo
+ (o NiceOfflineReading) <- want-to-have
+ (o OfflineArchiving) <- want-to-have
+ o OfflineEditing (text, html, pod, tavi)
+ o OnlinePublishing ()
+ --- engine
+ o LiveDispatching (ContentEncoding, ContentConversion, EnvelopeEncapsulation, GatewayToXyz)
+ o OfflineRendering (html, text, pdf, chm)
+ --- reader
+ o OnlineReading ()
+ (o SelectItemsForDownload) <- want-to-have
+ (o DownloadItems) <- want-to-have
+ o OfflineReading (pdf, chm)
+
+o link to http://teamsonar.no-ip.com
+
+o mail announces to announce@netfrag.org
+
+o no symlinks in webroot anymore? use ApacheAliases?
+
+o MiniHowto: NfoLinkageSystem(->news.nfo.announce)
+ o this declaration could mean:
+ o UseResources:
+ o look up "NfoLinkageSystem" as subject in newsgroup "news.nfo.announce" on default newsserver
+ o RenderThisWay:
+ o embed into document - html3
+ o embed into document - dhtml (ExpandTree, CollapseTree)
+ o LinkToIt (JumpToMechanism(->minihowto))
+
+o php: appcontrol: reads .appcontrolrc-files recursively from directories and adds/removes users or sets passwords
+ according to specification in there
+
+o source-code parser which creates documentation with wiki techniques
+ o pod2tavi -> tavi2html
+ o phpDoc <- tavi-plugin?
+
+o integrate yakka and newsportal:
+ o make a yakka-page of embedded news-articles / threads / thread-parts (a NewsComposition) (->YakkaPageMetadata)
+ o article-sources
+ o all items from one news-server
+ o !!! from different news-servers !!!
+ o add a "CommentThis"-links to each item when rendering
+ o when user posts the answer on YakkaEditPage
+ o make yakka post to the article's associated news-server (read from YakkaItemMetadata)
+ o wait until new article is published, then ...
+ o ... add to NewsComposition (update YakkaPageMetadata) (->AsynchronousBackendDaemon)
+ o ... use/introduce a MetaItem "New" into YakkaPageMetadata (at TopLevel)
+ which shows NewItems(->self, ->live) per thread or newsgroup
+
+o download this and that - e.g.:
+ o phpMyadmin(->archive.software.phpMyAdmin)
+ o this requires 'archive.software' to have ...
+ o ... a ListSearchHandler (searches nodelist below 'archive.software' only)
+ o ... a RecursiveSearchHandler (searches nodelist below 'archive.software' and all subfolders recursively)
+ o make this available as a ResourceHandler via a DispatchRequest sitting at
+ o http://netfrag.org/archive/?base=software&search=phpMyAdmin
+ o http://archive.netfrag.org/
+
+x rename newsgroup nfo.csm to nfo.caesar (Collaborative And Easy System Management)
+ x ctlinnd newgroup nfo.caesar
+ x /etc/init.d/inn stop
+ x cd /var/spool/news/nfo
+ x cp csm/* caesar/
+ x cd caesar
+ (x movearticle ...)
+ o chown news.news *
+ o /usr/lib/news/bin/makehistory
+ x THIS FAILED! DON'T DO IT
+
+o MiniHowto: KerberizedSystem (->~jonen)
+
+o RefWords -> LookUpDb -> SearchDb
+
+x added first news-article which refers/references to another one in another newsgroup
+ Requirement: LDAP For Aliases, Maps, And Classes
+ o PARSER-TODO: RefactorThisLink
+
+o check out /usr/sbin/checksecurity - what's that?
+ x seems to come from /etc/cron.daily/standard
+
+o write mail to the KroupwareMailingList
+
+o ContentIndexer for netfrag.org which should provide a FullTextSearch over AllResources
+
+o run MakeDoc at interval at netfrag.org as ServiceUser
+ o implement first version of makedoc
+ o use mkDoc.bat (or similar) for that purpose
+ o extend: use 'makedoc.bat|.pl' from ->cvs.joko.TestArea.topics.authoring.DocBook
+
+o DispatchRequest to tie all together
+ o just make a ref from almost everything and see what comes in....
+ o write handlers for the various refs....
+
+o show foldername in CVSSpam - message
+
+o SoWhyCommands?
+ o JustUseHumanLanguage!
+ o StartWithEnglish
+ o TryGerman
+
+o wrappers around the common used cvs commands
+ o cvscheckout
+ o cvsupdate
+ o cvscommit
+
+o newsportal
+ feature-idea: crosspost to another group
+
+o FreeTaskManagement
+
+o run-dotfiles -R fetchdoc|synccvs|makedoc
+
+o netfrag.org: "NewItems" (interacting with user's cookie's)
+
+
+
+
+
+
+
+
+$Id: joko_2003-01.html,v 1.78 2003/01/28 07:03:44 joko Exp $
+
+
+