--- joko/doc/SampleTasks/joko_2003-03.twingle 2003/03/10 23:55:51 1.34 +++ joko/doc/SampleTasks/joko_2003-03.twingle 2003/03/12 21:55:51 1.70 @@ -10,8 +10,104 @@ @sequence meta @document-history @cvs-info - $Id: joko_2003-03.twingle,v 1.34 2003/03/10 23:55:51 joko Exp $ + $Id: joko_2003-03.twingle,v 1.70 2003/03/12 21:55:51 joko Exp $ $Log: joko_2003-03.twingle,v $ + Revision 1.70 2003/03/12 21:55:51 joko + + AUTOCOMMIT: updated/added content + + Revision 1.68 2003/03/12 20:55:52 joko + + AUTOCOMMIT: updated/added content + + Revision 1.67 2003/03/12 20:25:52 joko + + AUTOCOMMIT: updated/added content + + Revision 1.66 2003/03/12 19:56:04 joko + + AUTOCOMMIT: updated/added content + + Revision 1.65 2003/03/12 19:25:53 joko + + AUTOCOMMIT: updated/added content + + Revision 1.64 2003/03/12 18:56:14 joko + + AUTOCOMMIT: updated/added content + + Revision 1.63 2003/03/12 18:25:53 joko + + AUTOCOMMIT: updated/added content + + Revision 1.62 2003/03/12 17:55:49 joko + + AUTOCOMMIT: updated/added content + + Revision 1.61 2003/03/12 17:25:49 joko + + AUTOCOMMIT: updated/added content + + Revision 1.60 2003/03/12 15:55:57 joko + + AUTOCOMMIT: updated/added content + + Revision 1.59 2003/03/12 05:56:09 joko + + AUTOCOMMIT: updated/added content + + Revision 1.58 2003/03/12 05:26:22 joko + + AUTOCOMMIT: updated/added content + + Revision 1.57 2003/03/12 04:55:52 joko + + AUTOCOMMIT: updated/added content + + Revision 1.56 2003/03/12 04:26:09 joko + + AUTOCOMMIT: updated/added content + + Revision 1.55 2003/03/12 02:55:54 joko + + AUTOCOMMIT: updated/added content + + Revision 1.54 2003/03/12 01:55:58 joko + + AUTOCOMMIT: updated/added content + + Revision 1.53 2003/03/12 01:25:57 joko + + AUTOCOMMIT: updated/added content + + Revision 1.52 2003/03/11 23:55:58 joko + + AUTOCOMMIT: updated/added content + + Revision 1.51 2003/03/11 23:25:49 joko + + AUTOCOMMIT: updated/added content + + Revision 1.50 2003/03/11 22:56:12 joko + + AUTOCOMMIT: updated/added content + + Revision 1.48 2003/03/11 22:03:23 joko + + AUTOCOMMIT: updated/added content + + Revision 1.47 2003/03/11 21:05:22 joko + + AUTOCOMMIT: updated/added content + + Revision 1.45 2003/03/11 18:55:52 joko + + AUTOCOMMIT: updated/added content + + Revision 1.43 2003/03/11 17:56:02 joko + + AUTOCOMMIT: updated/added content + + Revision 1.42 2003/03/11 15:26:01 joko + + AUTOCOMMIT: updated/added content + + Revision 1.41 2003/03/11 14:56:02 joko + + AUTOCOMMIT: updated/added content + + Revision 1.40 2003/03/11 06:25:59 joko + + AUTOCOMMIT: updated/added content + + Revision 1.39 2003/03/11 05:56:44 joko + + AUTOCOMMIT: updated/added content + + Revision 1.38 2003/03/11 05:26:23 joko + + AUTOCOMMIT: updated/added content + + Revision 1.37 2003/03/11 04:25:58 joko + + AUTOCOMMIT: updated/added content + + Revision 1.36 2003/03/11 02:55:54 joko + + AUTOCOMMIT: updated/added content + + Revision 1.35 2003/03/11 01:55:57 joko + + AUTOCOMMIT: updated/added content + Revision 1.34 2003/03/10 23:55:51 joko + AUTOCOMMIT: updated/added content @@ -451,10 +547,11 @@ o twingle -> dispatchmail (Twingle::Mail) o twingle -> twingledoc (Twingle::Doc) -o refactor to "twingled/": - o http://netfrag.org/~joko/computing/overview/topics/topics/ - o http://netfrag.org/~joko/computing/overview/topics/SampleTasks/ -o update http://netfrag.org/~joko/computing/overview/topics/topics.html +o update www.netfrag.org + o refactor to "twingled/": + o http://netfrag.org/~joko/computing/overview/topics/topics/ + o http://netfrag.org/~joko/computing/overview/topics/SampleTasks/ + o update http://netfrag.org/~joko/computing/overview/topics/topics.html x re-enable Yakka @@ -613,7 +710,9 @@ o quick (javascript) search for netfrag.org and packages.debian.org (xul?) -o phpDirectoryIndex: include Joshua Eichhorns 'auth' [[http://cvs.joshuaeichorn.com/cvsweb.cgi/auth/]] +o phpDirectoryIndex: + o integrate Joshua Eichhorns 'auth' [[http://cvs.joshuaeichorn.com/cvsweb.cgi/auth/]] + o hide more entries: e.g. 'CVS' (declare as "cvs-repository-metadata" - "hidden by default") @lookat http://cvs.joshuaeichorn.com/cvsweb.cgi/phpXmlTransform/ @@ -669,3 +768,382 @@ o from (e.g. test6/) o to (e.g. test6/zoomed/) +o global "last-recent-error"-page for admin to view errors occouring + ->SystemErrors + ->StepProcessing: ./.runrc: update|build|publish + +o clean up disks!!! + o h1.service.netfrag.org + o quepasa.netfrag.org + +o natraj/sorceress: server-consolidation? + +o monitor regularly: http://netfrag.org/docs/code/api/org.netfrag/errors.html + +o DataSource::Generic <-> ObjectList!!! + +o Yakka: (javascript-control): + o let CTRL + ENTER make a new para + o let CTRL + CTRL (double-hit) make a new page from WikiWord left of the cursor (splash into a new DHTML page!) + +x root@quepasa:/data# apt-get install pdumpfs + +o final solution for the libxml-problem? + root@quepasa:/home/service/backup# apt-get --fix-broken --show-upgraded --simulate dist-upgrade + Reading Package Lists... Done + Building Dependency Tree... Done + Correcting dependencies... Done + Calculating Upgrade... Done + The following packages will be REMOVED: + libxslt1 php4-domxml + 0 packages upgraded, 0 newly installed, 2 to remove and 0 not upgraded. + Remv libxslt1 (1.0.27-1 ) [php4-domxml ] + Remv php4-domxml (4:4.2.3-11 ) + root@quepasa:/tmp# apt-get install pdumpfs + Reading Package Lists... Done + Building Dependency Tree... Done + You might want to run `apt-get -f install' to correct these: + Sorry, but the following packages have unmet dependencies: + libxslt1: Depends: libxml2 (>= 2.5.0-1) but 2.4.19-4 is to be installed + php4-domxml: Depends: libxml2 (>= 2.5.0-1) but 2.4.19-4 is to be installed + E: Unmet dependencies. Try 'apt-get -f install' with no packages (or specify a solution). + x dpkg --force-depends -r libxml2 + o dpkg-liftpackage libxml2_2.4.19-4_i386.deb 2.5.0-1 + x dpkg-deb -x libxml2_2.4.19-4_i386.deb fakepkg + x dpkg-deb -e libxml2_2.4.19-4_i386.deb + x mv DEBIAN fakepkg/ + x dpkg-deb --build fakepkg libxml2_2.4.19-4_i386_fake_2.5.0-1.deb + x dpkg -i libxml2_2.4.19-4_i386_fake_2.5.0-1.deb + +o update www.netfrag.org +o announce on www.netfrag.org + o api-doc + o packages.netfrag.org (libxml2!) + o autogenerate: + o api-doc & diags + o twingle + +o ->search.netfrag.org/ruby + +o install and use 'monit' to monitor uml's! + +o refactor Yakka::YakkaSetup + +o quepasa - Error: AMaViS + + + Starting AMaViS Daemons: amavis-milter amavisd + Can't locate Razor/Client.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl) at /usr/sbin/amavisd line 54. + BEGIN failed--compilation aborted at /usr/sbin/amavisd line 54. + + + - probably because of perl-5.8.0? + + x apt-get install razor #)§$&( + solution: + x dpkg --force-depends -r razor + x wget http://ftp.de.debian.org/debian/pool/main/r/razor/razor_1.20-1_all.deb + x dpkg -i razor_1.20-1_all.deb + => depends on 'libtime-hires-perl', so: + x wget http://ftp.de.debian.org/debian/pool/main/libt/libtime-hires-perl/libtime-hires-perl_1.20-4_i386.deb + x dpkg -i libtime-hires-perl_1.20-4_i386.deb + dpkg: dependency problems prevent configuration of libtime-hires-perl: + libtime-hires-perl depends on perlapi-5.6.0; however: + Package perlapi-5.6.0 is not installed. + ;-( /)(%(/$%%&$ + => removing dependencies about everything from razor1-package + x dpkg -x razor_1.20-1_all.deb razor + x dpkg -r razor_1.20-1_all.deb + x mv DEBIAN/ razor/ + x do: remove line 'Depends:' from DEBIAN/control + [x chmod -R 0755 razor/DEBIAN/] maybe! (if: dpkg-deb: control directory has bad permissions 2755 (must be >=0755 and <=0775)) + x dpkg -b razor razor_1.20-1_all_nodeps.deb + x cp razor_1.20-1_all_nodeps.deb /data/Packages/dists/stable/contrib/binary-i386/ + => + x dpkg -i /data/Packages/dists/stable/contrib/binary-i386/razor_1.20-1_all_nodeps.deb + => [test] + x /etc/init.d/amavis-milter start + + Can't load '/usr/lib/perl5/auto/Time/HiRes/HiRes.so' for module Time::HiRes: /usr/lib/perl5/auto/Time/HiRes/HiRes.so: undefined symbol: PL_stack_max at /usr/lib/perl/5.8.0/DynaLoader.pm line 225. + at /usr/sbin/amavisd line 46 + Compilation failed in require at /usr/sbin/amavisd line 46. + BEGIN failed--compilation aborted at /usr/sbin/amavisd line 46. + + => [CPAN-install] + x perl -MCPAN -e "install Time::HiRes" + + [...] + compile -- compile -- compile + [...] + Running make install + Installing /usr/lib/perl/5.8.0/auto/Time/HiRes/HiRes.so + Files found in blib/arch: installing files in blib/lib into architecture dependent library tree + Installing /usr/lib/perl/5.8.0/Time/HiRes.pm + Installing /usr/share/man/man3/Time::HiRes.3pm + Writing /usr/lib/perl/5.8.0/auto/Time/HiRes/.packlist + Appending installation info to /usr/lib/perl/5.8.0/perllocal.pod + /usr/bin/make install -- OK + + + x probably because of perl-5.8.0? yes! -- is it fixed now? let's try... (again) + x /etc/init.d/amavis-milter restart + no! same error as above! + the problem is: + watch the output of 'perl -V' - at the bottom: + + Characteristics of this binary (from libperl): + Compile-time options: MULTIPLICITY USE_ITHREADS USE_LARGE_FILES PERL_IMPLICIT_CONTEXT + Built under linux + Compiled at Feb 17 2003 12:38:57 + @INC: + /etc/perl + /usr/local/lib/perl/5.8.0 + /usr/local/share/perl/5.8.0 + /usr/lib/perl5 + /usr/share/perl5 + /usr/lib/perl/5.8.0 + /usr/share/perl/5.8.0 + /usr/local/lib/site_perl + . + + + The bad one is the "old" shared object coming with Time::HiRes for perl-5.6.1 living at + /usr/lib/perl5/auto/Time/HiRes/HiRes.so. + + We have these options: + 1. delete this stuff + 2. put a better version at '.' + 3. place line '/usr/lib/perl/5.8.0' above of '/usr/lib/perl5' + 4. copy stuff from '/usr/lib/perl/5.8.0' to '/usr/lib/perl5' + + Hmmm..... + I think i'll choose option 1.: + x rm -rf /usr/lib/perl5/auto/Time/HiRes + (or if you don't wanna be as brute-force) + x cd /usr/lib/perl5/auto/Time + x mv HiRes HiRes.old + + => let's try again: + x /etc/init.d/amavis-milter restart + Time::HiRes object version 1.42 does not match bootstrap parameter 01.20 at /usr/lib/perl/5.8.0/DynaLoader.pm line 245. + + => ahhh... (also testable via 'perl -MTime::HiRes') + x dpkg --force-depends -r libtime-hires-perl + => my fault! ;-) + + => so, everything works fine now.... + x /etc/init.d/amavis-milter restart + +o BER.pm: BER (Basic Encoding Rules) encoding and decoding. + +o use a common [[http://razor.sourceforge.net/artistic.html|"Artistic License"]]? + +o use pdumpfs! + +o what we build seems similar to Torque <-> Maven (Tangram|XyZ+Data::Storage <-> nfo-libs|rap) + +o write meta-documentation about why it's required to lift version-numbers of debian-packages + -> Why dpkg-liftversion? + 1. yakka: libxml2!!! + 2. amavis-milter: razor-1-branch-required + +o installing pdumpfs as system-wide backup-system: + x mkdir -p /home/service/virtual/pdumpfs/var/data + x mkdir -p /home/service/virtual/pdumpfs/var/log + x cd /usr/local/bin + x ln -s /home/service/virtual/pdumpfs/backup . + +o feature: BrowsableBackup: + o missing: authentication via LDAP.... + +o make up toolpack from shortcuts/*, dispatchmail, backup (->pdumpfs), etc... + ->packages.service.netfrag.org + -->/usr/local/bin + +o one account - three services: + o wiki + o news + o backup + (o ssh) (not-a-must) + +o dpkg-modcontrol!!! + +o robinson - purge package dependencies from .deb- or .rpm-packages + can alien do that? + +o rsync working: view from the server-side: + 3968 ? R 0:40 rsync --server --sender -vulogDtprz . /home/service/backup/ + +x finally: we have a backup-system! + - built on top of pdumpfs (ruby!), gets triggered by cron through shortcut-script 'backup' + - backs up: + x /home/* (except /home/service) + x /data/bin (approx. 9.2M) + x /data/libs (approx. 1.7M) + x /data/opt (approx. 27M) + o /data/var (approx. 104M) + o mysql-db + o news-spool + o /data/www (approx. 126M) + x /data/www/virtual/lashlarue (approx. 28M) + x /data/www/virtual/netfrag (approx. 68M) + x /data/www/virtual/wac (approx. 4M) + o productive backup should go to /var/pdumpfs (similar to /var/backup) instead of /home/service/virtual/pdumpfs!!! + o prevent recursive backups (what happens if the backup directory itself would be specified to backup???) + => #> crontab -e + adding line: 03 03 * * * bash /home/service/virtual/agent/backup_all + o limit size of files that are backuped without user-request!?! (2MB, 10MB, 100MB, 1G) + +o establish logfile-rotation with logrotate!!! + #> cd /data/www/virtual/lashlarue/log + #> gzip access_log + #> gzip error_log + +o more todos: + x clean more diskspace + - How to find files larger than, hmm, let's say: 512MB? + use 'dus'! [Disk Usage Sorter] + http://marginalhacks.com/bin/dus + - now disk-usage-stats are prepared to be generated at service.netfrag.org (dus/fbf) + + - h1.service.netfrag.org + /dev/hda7 38570848 33162404 5408444 86% / + + + o /home/uml/skels aufräumen! + o draw more diagrams + o let 'monit' monitor our umls + - together with heartbeat! + o make more backups + databases: code (repository) and rdbms-sql (mysql) + +o look in /var/log/syslog after crash! (other logfiles?) + +o h1.service.netfrag.org: + rjoko@h1:/home/uml/helo # monit + monit: error while loading shared libraries: libssl.so.2: cannot open shared object file: No such file or directory + rjoko@h1:/home/uml/helo # deleeeeete backup!!! is it reeaaady? + +x h1.service.netfrag.org - ssh-upgrade [security] (2.9p2 -> 2.9.9p2) + rjoko@h1:~ # ssh -V + OpenSSH_2.9p2, SSH protocols 1.5/2.0, OpenSSL 0x0090602f + rjoko@h1:~ # rpm -U ftp://ftp.suse.com/pub/suse/i386/update/7.3/sec1/openssh.rpm + rjoko@h1:~ # ssh -V + OpenSSH_2.9.9p2, SSH protocols 1.5/2.0, OpenSSL 0x0090602f + +o what about legolas? + +o search-shortcut to rpmfind.net + +o request to hetzner: + please delete handle "CNO: MM458-ABC"... + +o update www.netfrag.org + o prevent errors like seen on http://netfrag.org/cgi-bin/viewcvs.cgi/joko/virtual/joko_mail/ + +o update www.netfrag.org + x HomePage (phpWiki::Index): remove yakka's "to be repaired" - line + o Overview: add link to DocumentIndex at section 'Documentation' + x update links (jonen's docs/software, etc.) + o rename http://netfrag.org/docs/build/ to http://netfrag.org/docs/.build/ or http://netfrag.org/docs/@build/ + o rename http://netfrag.org/docs/topics/caesar/ to http://netfrag.org/docs/topics/sysadmin/ ??? + x add new items to sections + x update/enhance news-section (Overview, Details) + +o run broken-link-finder on www.netfrag.org + -> find nice project! + +o infra for www.netfrag.org + o make this shortcut possible: http://netfrag.org/Overview + +o account for jonen@www.netfrag.org--phpWiki::* + +o twingle: + render 'o' and/or 'x' symbols as checkboxes other users can use to enable/prioritize tasks + +o backup eagle.netfrag.org!!! + +o enhance backup-system + LookAt::http://www.netfrag.org/webnews/article.php?id=320&group=nfo.links.computing + +o LookAt = MIME-compliant multi-glass + +o at note/attachment to documents shown via browser to inform user about backups made + (link to backup-locations/-urls) + +o search::admintools before actually starting a ToolHierarchy|ToolTree + +o http://www.netfrag.org/~joko/computing/overview/topics/SampleTasks/joko_2003-01.html + Torus::Publish::ReWeb <-> Torus::Publish::ResearchWeb ??? + +o search::IMAPFilter + +o QoS for apt-get!!! (http or ftp to x.debian.org or uni-erlangen.de (parse /etc/apt/sources.list!!!)) + +x jonen makes the words: integraded! yeah! + +o Develop a metadata-model (preferably stored inside an LDAP-daemon), + which can hold information about Host <-> vHost <-> Service(s). + This would enhance the Host <-> [posix]Account model currently in development. + o Also associate the [posix]Accounts with an AddressBook! (AddressBook <-> ProprietaryAddressBook) + o Also associate MailRouting with that [posix]Accounts + => this has to be implemented: + 0. already in development: Host <-> posixAccount, Host <-> MailRouting + 1. tbd: Host <-> vHost <-> Service(s) + 2. tbd: posixAccount <-> AddressBook + 3. tbd: posixAccount <-> MailRouting + +o use [rss2email|http://www.w3.org/2002/09/rss2email/] + -> that's it: news//rss -> rss2email + -> choose a web-based rss-reader from http://blogspace.com/rss/readers + o LookAt::[ModIndexRSS|http://software.tangent.org/projects.pl?view=mod_index_rss] + also look at "mod_repository for Apache" there!!! + +o close down almost everything on h1.service.netfrag.org + o ntop + o apache + o mysql + o vsd + o write (success-)story!!! + +o note about workflow: what about old root-emails on the main-host? + x purged old mboxes + -> just purge them? (admin-action: approve purge!) + #> cd /var/spool/mail + #> >root (updated recently) + #> >service (updated recently) + #> rm netsaint (last entry: Date/Time: Thu Jan 23 14:32:48 CET 2003) + o How to check if a mbox contains mud-only? try 'formail'! + #> formail + +o convert diffs of this file to rss-chunks to be able to feed them to a RecentChanged Page or arbitrary rss-aggregators + +o make up an "edit"-mode of this document: + o WorkFlow: "Make a personal WishList from items of another users TaskList." + o ToImplement: KISS, Click & Go + +o x.netfrag.org - a server made up of WebServices + +x glossary::KISS - Keep It Simple, Stupid + LookAt::http://whatis.techtarget.com/definition/0,,sid9_gci521694,00.html + + KISS Principle + The KISS (Keep It Simple, Stupid) Principle is self-descriptive and recognizes two things: + 1. People (including product and service users) generally want things that are simple, + meaning easy to learn and use. + 2. A company that makes products or furnishes services may find simplicity an advantage + for the company as well, since it tends to shorten time and reduce cost. + (Where the company is trying to use the principle on behalf of users, however, + design time may take longer and cost more, but the net effect will be beneficial since + easy-to-learn-and-use products and services tend to be cheaper to produce and service in the long run.) + The New Hacker's Dictionary, edited by Eric Raymond, says the the KISS Principle + is sometimes cited on a development project to fend off "creeping featurism." + + SeeAlso::[Ockham's razor|http://whatis.techtarget.com/definition/0,,sid9_gci212684,00.html] + +o look how Horde looks with the current 'chora'-stylesheet... + +o dsu2html: aggregate outputs from dsu to one or more linked html page(s) + +o server- & tool-consolidation (moonX, toolX) +