--- joko/doc/SampleTasks/joko_2003-03.twingle 2003/03/11 17:56:02 1.43 +++ joko/doc/SampleTasks/joko_2003-03.twingle 2003/03/12 22:55:51 1.72 @@ -10,8 +10,80 @@ @sequence meta @document-history @cvs-info - $Id: joko_2003-03.twingle,v 1.43 2003/03/11 17:56:02 joko Exp $ + $Id: joko_2003-03.twingle,v 1.72 2003/03/12 22:55:51 joko Exp $ $Log: joko_2003-03.twingle,v $ + Revision 1.72 2003/03/12 22:55:51 joko + + AUTOCOMMIT: updated/added content + + Revision 1.71 2003/03/12 22:25:51 joko + + AUTOCOMMIT: updated/added content + + Revision 1.68 2003/03/12 20:55:52 joko + + AUTOCOMMIT: updated/added content + + Revision 1.67 2003/03/12 20:25:52 joko + + AUTOCOMMIT: updated/added content + + Revision 1.66 2003/03/12 19:56:04 joko + + AUTOCOMMIT: updated/added content + + Revision 1.65 2003/03/12 19:25:53 joko + + AUTOCOMMIT: updated/added content + + Revision 1.64 2003/03/12 18:56:14 joko + + AUTOCOMMIT: updated/added content + + Revision 1.63 2003/03/12 18:25:53 joko + + AUTOCOMMIT: updated/added content + + Revision 1.62 2003/03/12 17:55:49 joko + + AUTOCOMMIT: updated/added content + + Revision 1.61 2003/03/12 17:25:49 joko + + AUTOCOMMIT: updated/added content + + Revision 1.60 2003/03/12 15:55:57 joko + + AUTOCOMMIT: updated/added content + + Revision 1.59 2003/03/12 05:56:09 joko + + AUTOCOMMIT: updated/added content + + Revision 1.58 2003/03/12 05:26:22 joko + + AUTOCOMMIT: updated/added content + + Revision 1.57 2003/03/12 04:55:52 joko + + AUTOCOMMIT: updated/added content + + Revision 1.56 2003/03/12 04:26:09 joko + + AUTOCOMMIT: updated/added content + + Revision 1.55 2003/03/12 02:55:54 joko + + AUTOCOMMIT: updated/added content + + Revision 1.54 2003/03/12 01:55:58 joko + + AUTOCOMMIT: updated/added content + + Revision 1.53 2003/03/12 01:25:57 joko + + AUTOCOMMIT: updated/added content + + Revision 1.52 2003/03/11 23:55:58 joko + + AUTOCOMMIT: updated/added content + + Revision 1.51 2003/03/11 23:25:49 joko + + AUTOCOMMIT: updated/added content + + Revision 1.50 2003/03/11 22:56:12 joko + + AUTOCOMMIT: updated/added content + + Revision 1.48 2003/03/11 22:03:23 joko + + AUTOCOMMIT: updated/added content + + Revision 1.47 2003/03/11 21:05:22 joko + + AUTOCOMMIT: updated/added content + + Revision 1.45 2003/03/11 18:55:52 joko + + AUTOCOMMIT: updated/added content + Revision 1.43 2003/03/11 17:56:02 joko + AUTOCOMMIT: updated/added content @@ -478,10 +550,11 @@ o twingle -> dispatchmail (Twingle::Mail) o twingle -> twingledoc (Twingle::Doc) -o refactor to "twingled/": - o http://netfrag.org/~joko/computing/overview/topics/topics/ - o http://netfrag.org/~joko/computing/overview/topics/SampleTasks/ -o update http://netfrag.org/~joko/computing/overview/topics/topics.html +o update www.netfrag.org + o refactor to "twingled/": + o http://netfrag.org/~joko/computing/overview/topics/topics/ + o http://netfrag.org/~joko/computing/overview/topics/SampleTasks/ + o update http://netfrag.org/~joko/computing/overview/topics/topics.html x re-enable Yakka @@ -640,7 +713,9 @@ o quick (javascript) search for netfrag.org and packages.debian.org (xul?) -o phpDirectoryIndex: include Joshua Eichhorns 'auth' [[http://cvs.joshuaeichorn.com/cvsweb.cgi/auth/]] +o phpDirectoryIndex: + o integrate Joshua Eichhorns 'auth' [[http://cvs.joshuaeichorn.com/cvsweb.cgi/auth/]] + o hide more entries: e.g. 'CVS' (declare as "cvs-repository-metadata" - "hidden by default") @lookat http://cvs.joshuaeichorn.com/cvsweb.cgi/phpXmlTransform/ @@ -743,6 +818,7 @@ x dpkg-deb --build fakepkg libxml2_2.4.19-4_i386_fake_2.5.0-1.deb x dpkg -i libxml2_2.4.19-4_i386_fake_2.5.0-1.deb +o update www.netfrag.org o announce on www.netfrag.org o api-doc o packages.netfrag.org (libxml2!) @@ -757,16 +833,352 @@ o refactor Yakka::YakkaSetup o quepasa - Error: AMaViS - Starting AMaViS Daemons: amavis-milter amavisdCan't locate Razor/Client.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl) at /usr/sbin/amavisd line 54. + + + Starting AMaViS Daemons: amavis-milter amavisd + Can't locate Razor/Client.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl) at /usr/sbin/amavisd line 54. BEGIN failed--compilation aborted at /usr/sbin/amavisd line 54. + + + - probably because of perl-5.8.0? + x apt-get install razor #)§$&( solution: x dpkg --force-depends -r razor x wget http://ftp.de.debian.org/debian/pool/main/r/razor/razor_1.20-1_all.deb - x wget http://ftp.de.debian.org/debian/pool/main/libt/libtime-hires-perl/libtime-hires-perl_1.20-4_i386.deb - x dpkg -i libtime-hires-perl_1.20-4_i386.deb x dpkg -i razor_1.20-1_all.deb + => depends on 'libtime-hires-perl', so: + x wget http://ftp.de.debian.org/debian/pool/main/libt/libtime-hires-perl/libtime-hires-perl_1.20-4_i386.deb + x dpkg -i libtime-hires-perl_1.20-4_i386.deb + dpkg: dependency problems prevent configuration of libtime-hires-perl: + libtime-hires-perl depends on perlapi-5.6.0; however: + Package perlapi-5.6.0 is not installed. + ;-( /)(%(/$%%&$ + => removing dependencies about everything from razor1-package + x dpkg -x razor_1.20-1_all.deb razor + x dpkg -r razor_1.20-1_all.deb + x mv DEBIAN/ razor/ + x do: remove line 'Depends:' from DEBIAN/control + [x chmod -R 0755 razor/DEBIAN/] maybe! (if: dpkg-deb: control directory has bad permissions 2755 (must be >=0755 and <=0775)) + x dpkg -b razor razor_1.20-1_all_nodeps.deb + x cp razor_1.20-1_all_nodeps.deb /data/Packages/dists/stable/contrib/binary-i386/ + => + x dpkg -i /data/Packages/dists/stable/contrib/binary-i386/razor_1.20-1_all_nodeps.deb + => [test] + x /etc/init.d/amavis-milter start + + Can't load '/usr/lib/perl5/auto/Time/HiRes/HiRes.so' for module Time::HiRes: /usr/lib/perl5/auto/Time/HiRes/HiRes.so: undefined symbol: PL_stack_max at /usr/lib/perl/5.8.0/DynaLoader.pm line 225. + at /usr/sbin/amavisd line 46 + Compilation failed in require at /usr/sbin/amavisd line 46. + BEGIN failed--compilation aborted at /usr/sbin/amavisd line 46. + + => [CPAN-install] + x perl -MCPAN -e "install Time::HiRes" + + [...] + compile -- compile -- compile + [...] + Running make install + Installing /usr/lib/perl/5.8.0/auto/Time/HiRes/HiRes.so + Files found in blib/arch: installing files in blib/lib into architecture dependent library tree + Installing /usr/lib/perl/5.8.0/Time/HiRes.pm + Installing /usr/share/man/man3/Time::HiRes.3pm + Writing /usr/lib/perl/5.8.0/auto/Time/HiRes/.packlist + Appending installation info to /usr/lib/perl/5.8.0/perllocal.pod + /usr/bin/make install -- OK + + + x probably because of perl-5.8.0? yes! -- is it fixed now? let's try... (again) + x /etc/init.d/amavis-milter restart + no! same error as above! + the problem is: + watch the output of 'perl -V' - at the bottom: + + Characteristics of this binary (from libperl): + Compile-time options: MULTIPLICITY USE_ITHREADS USE_LARGE_FILES PERL_IMPLICIT_CONTEXT + Built under linux + Compiled at Feb 17 2003 12:38:57 + @INC: + /etc/perl + /usr/local/lib/perl/5.8.0 + /usr/local/share/perl/5.8.0 + /usr/lib/perl5 + /usr/share/perl5 + /usr/lib/perl/5.8.0 + /usr/share/perl/5.8.0 + /usr/local/lib/site_perl + . + + + The bad one is the "old" shared object coming with Time::HiRes for perl-5.6.1 living at + /usr/lib/perl5/auto/Time/HiRes/HiRes.so. + + We have these options: + 1. delete this stuff + 2. put a better version at '.' + 3. place line '/usr/lib/perl/5.8.0' above of '/usr/lib/perl5' + 4. copy stuff from '/usr/lib/perl/5.8.0' to '/usr/lib/perl5' + + Hmmm..... + I think i'll choose option 1.: + x rm -rf /usr/lib/perl5/auto/Time/HiRes + (or if you don't wanna be as brute-force) + x cd /usr/lib/perl5/auto/Time + x mv HiRes HiRes.old + + => let's try again: + x /etc/init.d/amavis-milter restart + Time::HiRes object version 1.42 does not match bootstrap parameter 01.20 at /usr/lib/perl/5.8.0/DynaLoader.pm line 245. + + => ahhh... (also testable via 'perl -MTime::HiRes') + x dpkg --force-depends -r libtime-hires-perl + => my fault! ;-) + => so, everything works fine now.... + x /etc/init.d/amavis-milter restart + o BER.pm: BER (Basic Encoding Rules) encoding and decoding. +o use a common [[http://razor.sourceforge.net/artistic.html|"Artistic License"]]? + +o use pdumpfs! + +o what we build seems similar to Torque <-> Maven (Tangram|XyZ+Data::Storage <-> nfo-libs|rap) + +o write meta-documentation about why it's required to lift version-numbers of debian-packages + -> Why dpkg-liftversion? + 1. yakka: libxml2!!! + 2. amavis-milter: razor-1-branch-required + +o installing pdumpfs as system-wide backup-system: + x mkdir -p /home/service/virtual/pdumpfs/var/data + x mkdir -p /home/service/virtual/pdumpfs/var/log + x cd /usr/local/bin + x ln -s /home/service/virtual/pdumpfs/backup . + +o feature: BrowsableBackup: + o missing: authentication via LDAP.... + +o make up toolpack from shortcuts/*, dispatchmail, backup (->pdumpfs), etc... + ->packages.service.netfrag.org + -->/usr/local/bin + +o one account - three services: + o wiki + o news + o backup + (o ssh) (not-a-must) + +o dpkg-modcontrol!!! + +o robinson - purge package dependencies from .deb- or .rpm-packages + can alien do that? + +o rsync working: view from the server-side: + 3968 ? R 0:40 rsync --server --sender -vulogDtprz . /home/service/backup/ + +x finally: we have a backup-system! + - built on top of pdumpfs (ruby!), gets triggered by cron through shortcut-script 'backup' + - backs up: + x /home/* (except /home/service) + x /data/bin (approx. 9.2M) + x /data/libs (approx. 1.7M) + x /data/opt (approx. 27M) + o /data/var (approx. 104M) + o mysql-db + o news-spool + o /data/www (approx. 126M) + x /data/www/virtual/lashlarue (approx. 28M) + x /data/www/virtual/netfrag (approx. 68M) + x /data/www/virtual/wac (approx. 4M) + o productive backup should go to /var/pdumpfs (similar to /var/backup) instead of /home/service/virtual/pdumpfs!!! + o prevent recursive backups (what happens if the backup directory itself would be specified to backup???) + => #> crontab -e + adding line: 03 03 * * * bash /home/service/virtual/agent/backup_all + o limit size of files that are backuped without user-request!?! (2MB, 10MB, 100MB, 1G) + +o establish logfile-rotation with logrotate!!! + #> cd /data/www/virtual/lashlarue/log + #> gzip access_log + #> gzip error_log + +o more todos: + x clean more diskspace + - How to find files larger than, hmm, let's say: 512MB? + use 'dus'! [Disk Usage Sorter] + http://marginalhacks.com/bin/dus + - now disk-usage-stats are prepared to be generated at service.netfrag.org (dus/fbf) + + - h1.service.netfrag.org + /dev/hda7 38570848 33162404 5408444 86% / + + + o /home/uml/skels aufräumen! + o draw more diagrams + o let 'monit' monitor our umls + - together with heartbeat! + o make more backups + databases: code (repository) and rdbms-sql (mysql) + +o look in /var/log/syslog after crash! (other logfiles?) + +o h1.service.netfrag.org: + rjoko@h1:/home/uml/helo # monit + monit: error while loading shared libraries: libssl.so.2: cannot open shared object file: No such file or directory + rjoko@h1:/home/uml/helo # deleeeeete backup!!! is it reeaaady? + +x h1.service.netfrag.org - ssh-upgrade [security] (2.9p2 -> 2.9.9p2) + rjoko@h1:~ # ssh -V + OpenSSH_2.9p2, SSH protocols 1.5/2.0, OpenSSL 0x0090602f + rjoko@h1:~ # rpm -U ftp://ftp.suse.com/pub/suse/i386/update/7.3/sec1/openssh.rpm + rjoko@h1:~ # ssh -V + OpenSSH_2.9.9p2, SSH protocols 1.5/2.0, OpenSSL 0x0090602f + +o what about legolas? + +o search-shortcut to rpmfind.net + +o request to hetzner: + please delete handle "CNO: MM458-ABC"... + +o update www.netfrag.org + o prevent errors like seen on http://netfrag.org/cgi-bin/viewcvs.cgi/joko/virtual/joko_mail/ + +o update www.netfrag.org + x HomePage (phpWiki::Index): remove yakka's "to be repaired" - line + o Overview: add link to DocumentIndex at section 'Documentation' + x update links (jonen's docs/software, etc.) + o rename http://netfrag.org/docs/build/ to http://netfrag.org/docs/.build/ or http://netfrag.org/docs/@build/ + o rename http://netfrag.org/docs/topics/caesar/ to http://netfrag.org/docs/topics/sysadmin/ ??? + x add new items to sections + x update/enhance news-section (Overview, Details) + +o run broken-link-finder on www.netfrag.org + -> find nice project! + +o infra for www.netfrag.org + o make this shortcut possible: http://netfrag.org/Overview + +o account for jonen@www.netfrag.org--phpWiki::* + +o twingle: + render 'o' and/or 'x' symbols as checkboxes other users can use to enable/prioritize tasks + +o backup eagle.netfrag.org!!! + +o enhance backup-system + LookAt::http://www.netfrag.org/webnews/article.php?id=320&group=nfo.links.computing + +o LookAt = MIME-compliant multi-glass + +o at note/attachment to documents shown via browser to inform user about backups made + (link to backup-locations/-urls) + +o search::admintools before actually starting a ToolHierarchy|ToolTree + +o http://www.netfrag.org/~joko/computing/overview/topics/SampleTasks/joko_2003-01.html + Torus::Publish::ReWeb <-> Torus::Publish::ResearchWeb ??? + +o search::IMAPFilter + +o QoS for apt-get!!! (http or ftp to x.debian.org or uni-erlangen.de (parse /etc/apt/sources.list!!!)) + +x jonen makes the words: integraded! yeah! + +o Develop a metadata-model (preferably stored inside an LDAP-daemon), + which can hold information about Host <-> vHost <-> Service(s). + This would enhance the Host <-> [posix]Account model currently in development. + o Also associate the [posix]Accounts with an AddressBook! (AddressBook <-> ProprietaryAddressBook) + o Also associate MailRouting with that [posix]Accounts + => this has to be implemented: + 0. already in development: Host <-> posixAccount, Host <-> MailRouting + 1. tbd: Host <-> vHost <-> Service(s) + 2. tbd: posixAccount <-> AddressBook + 3. tbd: posixAccount <-> MailRouting + +o use [rss2email|http://www.w3.org/2002/09/rss2email/] + -> that's it: news//rss -> rss2email + -> choose a web-based rss-reader from http://blogspace.com/rss/readers + o LookAt::[ModIndexRSS|http://software.tangent.org/projects.pl?view=mod_index_rss] + also look at "mod_repository for Apache" there!!! + +o close down almost everything on h1.service.netfrag.org + o ntop + o apache + o mysql + o vsd + o write (success-)story!!! + +o note about workflow / FAQ: what about old root-emails on the main-host? + x purged old mboxes + -> just purge them? (admin-action: approve purge!) + #> cd /var/spool/mail + #> >root (updated recently) + #> >service (updated recently) + #> rm netsaint (last entry: Date/Time: Thu Jan 23 14:32:48 CET 2003) + o Write MiniHowTo: How to check if a mbox contains mud-only? try 'formail'! + #> cat {mbox-file} | formail -I "" | less + from 'man formail': + To extract the header from a message: + formail -X "" + or + sed -e '/^$/ q' + + To extract the body from a message: + formail -I "" + or + sed -e '1,/^$/ d' + x purged old mboxes: + #> rm rfms (last entry: Date: Fri, 6 Dec 2002 20:45:01 +0100) + #> rm jonen (last entry: Jun 25 2002) + + + +o convert diffs of this file to rss-chunks to be able to feed them to a RecentChanged Page or arbitrary rss-aggregators + +o make up an "edit"-mode of this document: + o WorkFlow: "Make a personal WishList from items of another users TaskList." + o ToImplement: KISS, Click & Go + +o x.netfrag.org - a server made up of WebServices + +x glossary::KISS - Keep It Simple, Stupid + LookAt::http://whatis.techtarget.com/definition/0,,sid9_gci521694,00.html + + KISS Principle + The KISS (Keep It Simple, Stupid) Principle is self-descriptive and recognizes two things: + 1. People (including product and service users) generally want things that are simple, + meaning easy to learn and use. + 2. A company that makes products or furnishes services may find simplicity an advantage + for the company as well, since it tends to shorten time and reduce cost. + (Where the company is trying to use the principle on behalf of users, however, + design time may take longer and cost more, but the net effect will be beneficial since + easy-to-learn-and-use products and services tend to be cheaper to produce and service in the long run.) + The New Hacker's Dictionary, edited by Eric Raymond, says the the KISS Principle + is sometimes cited on a development project to fend off "creeping featurism." + + SeeAlso::[Ockham's razor|http://whatis.techtarget.com/definition/0,,sid9_gci212684,00.html] + +o look how Horde looks with the current 'chora'-stylesheet... + +o dsu2html: aggregate outputs from dsu to one or more linked html page(s) + +o server- & tool-consolidation (moonX, toolX) + +o phpDocumentIndex should get different "modes": + o ViewMode (normal, twingled, etc.) + o ParsedMode (into rss-chunks by diff2rss) + o RevisionMode (per file, if .ext == ',v') + +o generic framework to build a backend for a web-based ProductBuilder (like alternate's PC-Builder and many others) + o Zwischensumme + +o komplan.com - Homepage!!! + +o translate selfhtml? + +o search::[php & rss & Dublin Core] + +o "what happens if 'dispatchmail' prints something to the console" or ... + "check out how to let dispatchmail append stuff to /var/log/syslog"