--- joko/doc/SampleTasks/joko_2003-03.twingle 2003/03/09 19:26:12 1.26 +++ joko/doc/SampleTasks/joko_2003-03.twingle 2003/03/12 18:56:14 1.64 @@ -10,9 +10,108 @@ @sequence meta @document-history @cvs-info - $Id: joko_2003-03.twingle,v 1.26 2003/03/09 19:26:12 joko Exp $ + $Id: joko_2003-03.twingle,v 1.64 2003/03/12 18:56:14 joko Exp $ $Log: joko_2003-03.twingle,v $ - Revision 1.26 2003/03/09 19:26:12 joko + Revision 1.64 2003/03/12 18:56:14 joko + + AUTOCOMMIT: updated/added content + + Revision 1.63 2003/03/12 18:25:53 joko + + AUTOCOMMIT: updated/added content + + Revision 1.62 2003/03/12 17:55:49 joko + + AUTOCOMMIT: updated/added content + + Revision 1.61 2003/03/12 17:25:49 joko + + AUTOCOMMIT: updated/added content + + Revision 1.60 2003/03/12 15:55:57 joko + + AUTOCOMMIT: updated/added content + + Revision 1.59 2003/03/12 05:56:09 joko + + AUTOCOMMIT: updated/added content + + Revision 1.58 2003/03/12 05:26:22 joko + + AUTOCOMMIT: updated/added content + + Revision 1.57 2003/03/12 04:55:52 joko + + AUTOCOMMIT: updated/added content + + Revision 1.56 2003/03/12 04:26:09 joko + + AUTOCOMMIT: updated/added content + + Revision 1.55 2003/03/12 02:55:54 joko + + AUTOCOMMIT: updated/added content + + Revision 1.54 2003/03/12 01:55:58 joko + + AUTOCOMMIT: updated/added content + + Revision 1.53 2003/03/12 01:25:57 joko + + AUTOCOMMIT: updated/added content + + Revision 1.52 2003/03/11 23:55:58 joko + + AUTOCOMMIT: updated/added content + + Revision 1.51 2003/03/11 23:25:49 joko + + AUTOCOMMIT: updated/added content + + Revision 1.50 2003/03/11 22:56:12 joko + + AUTOCOMMIT: updated/added content + + Revision 1.48 2003/03/11 22:03:23 joko + + AUTOCOMMIT: updated/added content + + Revision 1.47 2003/03/11 21:05:22 joko + + AUTOCOMMIT: updated/added content + + Revision 1.45 2003/03/11 18:55:52 joko + + AUTOCOMMIT: updated/added content + + Revision 1.43 2003/03/11 17:56:02 joko + + AUTOCOMMIT: updated/added content + + Revision 1.42 2003/03/11 15:26:01 joko + + AUTOCOMMIT: updated/added content + + Revision 1.41 2003/03/11 14:56:02 joko + + AUTOCOMMIT: updated/added content + + Revision 1.40 2003/03/11 06:25:59 joko + + AUTOCOMMIT: updated/added content + + Revision 1.39 2003/03/11 05:56:44 joko + + AUTOCOMMIT: updated/added content + + Revision 1.38 2003/03/11 05:26:23 joko + + AUTOCOMMIT: updated/added content + + Revision 1.37 2003/03/11 04:25:58 joko + + AUTOCOMMIT: updated/added content + + Revision 1.36 2003/03/11 02:55:54 joko + + AUTOCOMMIT: updated/added content + + Revision 1.35 2003/03/11 01:55:57 joko + + AUTOCOMMIT: updated/added content + + Revision 1.34 2003/03/10 23:55:51 joko + + AUTOCOMMIT: updated/added content + + Revision 1.33 2003/03/10 18:55:55 joko + + AUTOCOMMIT: updated/added content + + Revision 1.32 2003/03/10 17:56:05 joko + + AUTOCOMMIT: updated/added content + + Revision 1.31 2003/03/10 16:25:55 joko + + AUTOCOMMIT: updated/added content + + Revision 1.30 2003/03/10 03:56:32 joko + + AUTOCOMMIT: updated/added content + + Revision 1.29 2003/03/10 03:27:24 joko + + AUTOCOMMIT: updated/added content + + Revision 1.27 2003/03/09 19:56:04 joko + AUTOCOMMIT: updated/added content Revision 1.25 2003/03/08 23:26:21 joko @@ -433,10 +532,11 @@ o twingle -> dispatchmail (Twingle::Mail) o twingle -> twingledoc (Twingle::Doc) -o refactor to "twingled/": - o http://netfrag.org/~joko/computing/overview/topics/topics/ - o http://netfrag.org/~joko/computing/overview/topics/SampleTasks/ -o update http://netfrag.org/~joko/computing/overview/topics/topics.html +o update www.netfrag.org + o refactor to "twingled/": + o http://netfrag.org/~joko/computing/overview/topics/topics/ + o http://netfrag.org/~joko/computing/overview/topics/SampleTasks/ + o update http://netfrag.org/~joko/computing/overview/topics/topics.html x re-enable Yakka @@ -595,7 +695,9 @@ o quick (javascript) search for netfrag.org and packages.debian.org (xul?) -o phpDirectoryIndex: include Joshua Eichhorns 'auth' [[http://cvs.joshuaeichorn.com/cvsweb.cgi/auth/]] +o phpDirectoryIndex: + o integrate Joshua Eichhorns 'auth' [[http://cvs.joshuaeichorn.com/cvsweb.cgi/auth/]] + o hide more entries: e.g. 'CVS' (declare as "cvs-repository-metadata" - "hidden by default") @lookat http://cvs.joshuaeichorn.com/cvsweb.cgi/phpXmlTransform/ @@ -605,12 +707,22 @@ o phpDocumentor: try php 4.3.0 for having cross-indexed browsable source as an additional feature ;-) o <-> link to pages prepared by Autodia o add additional browser in top left frame for cross-domain-browsing (having multiple apis beside each other) - o the html-title! + o the html-title! (make it unique!!!) o for Autodia: o resize images to a) 800x600 portrait and b) DIN A 4 square or s.th.l.th. => x .autozoom -> zoomall -> zoommulti -> zoomone o stamp picture with header and footer (little expressions for including predefined title, current filename, date, etc.!) + o idea: render as SVG??? + o class- and package-diagrams: + o "Class" for relationships of Code- and DB-Schema-classes + o "Package" for relationships of code-packages + o integrate with phpDocumentor: + /data/opt/tools/phpdocumentor/phpDocumentor/Converters/HTML/frames/templates/phpedit/templates/left_frame.tpl + o Autodia-TODO: + Add ability to split projects into multiple diagrams and group contents of + a diagram/subdir into system boxes - much improving clarity in big + projects. o glib-namespace aufräumen! @@ -623,4 +735,333 @@ o phpDocumentIndex o recognize symlinked directories!!! o integrate with ImageZoom written for Autodia + -> manipulate images: zoom, rotate + o sort order: + o default: show directories on top + o make changable through columns + o option to force view of hidden files (e.g. dot-files) + o 24h-time-format (no AM/PM) + o UML-Class-diagram-icon for tutorial!!! + +o modify /etc/hosts entry by rule!!!! + +o Yakka: automate reinstallation (new IntervalRunnerAgent) of libxml2 + #> dpkg -i /home/bareface/public_html/yakka/data/libxml2_2.4.19-4_i386.deb + #> /etc/init.d/apache restart + +o autozoom/runzoom + o from (e.g. test6/) + o to (e.g. test6/zoomed/) + +o global "last-recent-error"-page for admin to view errors occouring + ->SystemErrors + ->StepProcessing: ./.runrc: update|build|publish + +o clean up disks!!! + o h1.service.netfrag.org + o quepasa.netfrag.org + +o natraj/sorceress: server-consolidation? + +o monitor regularly: http://netfrag.org/docs/code/api/org.netfrag/errors.html + +o DataSource::Generic <-> ObjectList!!! + +o Yakka: (javascript-control): + o let CTRL + ENTER make a new para + o let CTRL + CTRL (double-hit) make a new page from WikiWord left of the cursor (splash into a new DHTML page!) + +x root@quepasa:/data# apt-get install pdumpfs + +o final solution for the libxml-problem? + root@quepasa:/home/service/backup# apt-get --fix-broken --show-upgraded --simulate dist-upgrade + Reading Package Lists... Done + Building Dependency Tree... Done + Correcting dependencies... Done + Calculating Upgrade... Done + The following packages will be REMOVED: + libxslt1 php4-domxml + 0 packages upgraded, 0 newly installed, 2 to remove and 0 not upgraded. + Remv libxslt1 (1.0.27-1 ) [php4-domxml ] + Remv php4-domxml (4:4.2.3-11 ) + root@quepasa:/tmp# apt-get install pdumpfs + Reading Package Lists... Done + Building Dependency Tree... Done + You might want to run `apt-get -f install' to correct these: + Sorry, but the following packages have unmet dependencies: + libxslt1: Depends: libxml2 (>= 2.5.0-1) but 2.4.19-4 is to be installed + php4-domxml: Depends: libxml2 (>= 2.5.0-1) but 2.4.19-4 is to be installed + E: Unmet dependencies. Try 'apt-get -f install' with no packages (or specify a solution). + x dpkg --force-depends -r libxml2 + o dpkg-liftpackage libxml2_2.4.19-4_i386.deb 2.5.0-1 + x dpkg-deb -x libxml2_2.4.19-4_i386.deb fakepkg + x dpkg-deb -e libxml2_2.4.19-4_i386.deb + x mv DEBIAN fakepkg/ + x dpkg-deb --build fakepkg libxml2_2.4.19-4_i386_fake_2.5.0-1.deb + x dpkg -i libxml2_2.4.19-4_i386_fake_2.5.0-1.deb + +o update www.netfrag.org +o announce on www.netfrag.org + o api-doc + o packages.netfrag.org (libxml2!) + o autogenerate: + o api-doc & diags + o twingle + +o ->search.netfrag.org/ruby + +o install and use 'monit' to monitor uml's! + +o refactor Yakka::YakkaSetup + +o quepasa - Error: AMaViS + + + Starting AMaViS Daemons: amavis-milter amavisd + Can't locate Razor/Client.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.8.0 /usr/local/share/perl/5.8.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.8.0 /usr/share/perl/5.8.0 /usr/local/lib/site_perl) at /usr/sbin/amavisd line 54. + BEGIN failed--compilation aborted at /usr/sbin/amavisd line 54. + + + - probably because of perl-5.8.0? + + x apt-get install razor #)§$&( + solution: + x dpkg --force-depends -r razor + x wget http://ftp.de.debian.org/debian/pool/main/r/razor/razor_1.20-1_all.deb + x dpkg -i razor_1.20-1_all.deb + => depends on 'libtime-hires-perl', so: + x wget http://ftp.de.debian.org/debian/pool/main/libt/libtime-hires-perl/libtime-hires-perl_1.20-4_i386.deb + x dpkg -i libtime-hires-perl_1.20-4_i386.deb + dpkg: dependency problems prevent configuration of libtime-hires-perl: + libtime-hires-perl depends on perlapi-5.6.0; however: + Package perlapi-5.6.0 is not installed. + ;-( /)(%(/$%%&$ + => removing dependencies about everything from razor1-package + x dpkg -x razor_1.20-1_all.deb razor + x dpkg -r razor_1.20-1_all.deb + x mv DEBIAN/ razor/ + x do: remove line 'Depends:' from DEBIAN/control + [x chmod -R 0755 razor/DEBIAN/] maybe! (if: dpkg-deb: control directory has bad permissions 2755 (must be >=0755 and <=0775)) + x dpkg -b razor razor_1.20-1_all_nodeps.deb + x cp razor_1.20-1_all_nodeps.deb /data/Packages/dists/stable/contrib/binary-i386/ + => + x dpkg -i /data/Packages/dists/stable/contrib/binary-i386/razor_1.20-1_all_nodeps.deb + => [test] + x /etc/init.d/amavis-milter start + + Can't load '/usr/lib/perl5/auto/Time/HiRes/HiRes.so' for module Time::HiRes: /usr/lib/perl5/auto/Time/HiRes/HiRes.so: undefined symbol: PL_stack_max at /usr/lib/perl/5.8.0/DynaLoader.pm line 225. + at /usr/sbin/amavisd line 46 + Compilation failed in require at /usr/sbin/amavisd line 46. + BEGIN failed--compilation aborted at /usr/sbin/amavisd line 46. + + => [CPAN-install] + x perl -MCPAN -e "install Time::HiRes" + + [...] + compile -- compile -- compile + [...] + Running make install + Installing /usr/lib/perl/5.8.0/auto/Time/HiRes/HiRes.so + Files found in blib/arch: installing files in blib/lib into architecture dependent library tree + Installing /usr/lib/perl/5.8.0/Time/HiRes.pm + Installing /usr/share/man/man3/Time::HiRes.3pm + Writing /usr/lib/perl/5.8.0/auto/Time/HiRes/.packlist + Appending installation info to /usr/lib/perl/5.8.0/perllocal.pod + /usr/bin/make install -- OK + + + x probably because of perl-5.8.0? yes! -- is it fixed now? let's try... (again) + x /etc/init.d/amavis-milter restart + no! same error as above! + the problem is: + watch the output of 'perl -V' - at the bottom: + + Characteristics of this binary (from libperl): + Compile-time options: MULTIPLICITY USE_ITHREADS USE_LARGE_FILES PERL_IMPLICIT_CONTEXT + Built under linux + Compiled at Feb 17 2003 12:38:57 + @INC: + /etc/perl + /usr/local/lib/perl/5.8.0 + /usr/local/share/perl/5.8.0 + /usr/lib/perl5 + /usr/share/perl5 + /usr/lib/perl/5.8.0 + /usr/share/perl/5.8.0 + /usr/local/lib/site_perl + . + + + The bad one is the "old" shared object coming with Time::HiRes for perl-5.6.1 living at + /usr/lib/perl5/auto/Time/HiRes/HiRes.so. + + We have these options: + 1. delete this stuff + 2. put a better version at '.' + 3. place line '/usr/lib/perl/5.8.0' above of '/usr/lib/perl5' + 4. copy stuff from '/usr/lib/perl/5.8.0' to '/usr/lib/perl5' + + Hmmm..... + I think i'll choose option 1.: + x rm -rf /usr/lib/perl5/auto/Time/HiRes + (or if you don't wanna be as brute-force) + x cd /usr/lib/perl5/auto/Time + x mv HiRes HiRes.old + + => let's try again: + x /etc/init.d/amavis-milter restart + Time::HiRes object version 1.42 does not match bootstrap parameter 01.20 at /usr/lib/perl/5.8.0/DynaLoader.pm line 245. + + => ahhh... (also testable via 'perl -MTime::HiRes') + x dpkg --force-depends -r libtime-hires-perl + => my fault! ;-) + + => so, everything works fine now.... + x /etc/init.d/amavis-milter restart + +o BER.pm: BER (Basic Encoding Rules) encoding and decoding. + +o use a common [[http://razor.sourceforge.net/artistic.html|"Artistic License"]]? + +o use pdumpfs! + +o what we build seems similar to Torque <-> Maven (Tangram|XyZ+Data::Storage <-> nfo-libs|rap) + +o write meta-documentation about why it's required to lift version-numbers of debian-packages + -> Why dpkg-liftversion? + 1. yakka: libxml2!!! + 2. amavis-milter: razor-1-branch-required + +o installing pdumpfs as system-wide backup-system: + x mkdir -p /home/service/virtual/pdumpfs/var/data + x mkdir -p /home/service/virtual/pdumpfs/var/log + x cd /usr/local/bin + x ln -s /home/service/virtual/pdumpfs/backup . + +o feature: BrowsableBackup: + o missing: authentication via LDAP.... + +o make up toolpack from shortcuts/*, dispatchmail, backup (->pdumpfs), etc... + ->packages.service.netfrag.org + -->/usr/local/bin + +o one account - three services: + o wiki + o news + o backup + (o ssh) (not-a-must) + +o dpkg-modcontrol!!! + +o robinson - purge package dependencies from .deb- or .rpm-packages + can alien do that? + +o rsync working: view from the server-side: + 3968 ? R 0:40 rsync --server --sender -vulogDtprz . /home/service/backup/ + +x finally: we have a backup-system! + - built on top of pdumpfs (ruby!), gets triggered by cron through shortcut-script 'backup' + - backs up: + x /home/* (except /home/service) + x /data/bin (approx. 9.2M) + x /data/libs (approx. 1.7M) + x /data/opt (approx. 27M) + o /data/var (approx. 104M) + o mysql-db + o news-spool + o /data/www (approx. 126M) + x /data/www/virtual/lashlarue (approx. 28M) + x /data/www/virtual/netfrag (approx. 68M) + x /data/www/virtual/wac (approx. 4M) + o productive backup should go to /var/pdumpfs (similar to /var/backup) instead of /home/service/virtual/pdumpfs!!! + o prevent recursive backups (what happens if the backup directory itself would be specified to backup???) + => #> crontab -e + adding line: 03 03 * * * bash /home/service/virtual/agent/backup_all + o limit size of files that are backuped without user-request!?! (2MB, 10MB, 100MB, 1G) + +o establish logfile-rotation with logrotate!!! + #> cd /data/www/virtual/lashlarue/log + #> gzip access_log + #> gzip error_log + +o more todos: + x clean more diskspace + - How to find files larger than, hmm, let's say: 512MB? + use 'dus'! [Disk Usage Sorter] + http://marginalhacks.com/bin/dus + - now disk-usage-stats are prepared to be generated at service.netfrag.org (dus/fbf) + + - h1.service.netfrag.org + /dev/hda7 38570848 33162404 5408444 86% / + + + o /home/uml/skels aufräumen! + o draw more diagrams + o let 'monit' monitor our umls + - together with heartbeat! + o make more backups + databases: code (repository) and rdbms-sql (mysql) + +o look in /var/log/syslog after crash! (other logfiles?) + +o h1.service.netfrag.org: + rjoko@h1:/home/uml/helo # monit + monit: error while loading shared libraries: libssl.so.2: cannot open shared object file: No such file or directory + rjoko@h1:/home/uml/helo # deleeeeete backup!!! is it reeaaady? + +x h1.service.netfrag.org - ssh-upgrade [security] (2.9p2 -> 2.9.9p2) + rjoko@h1:~ # ssh -V + OpenSSH_2.9p2, SSH protocols 1.5/2.0, OpenSSL 0x0090602f + rjoko@h1:~ # rpm -U ftp://ftp.suse.com/pub/suse/i386/update/7.3/sec1/openssh.rpm + rjoko@h1:~ # ssh -V + OpenSSH_2.9.9p2, SSH protocols 1.5/2.0, OpenSSL 0x0090602f + +o what about legolas? + +o search-shortcut to rpmfind.net + +o request to hetzner: + please delete handle "CNO: MM458-ABC"... + +o update www.netfrag.org + o prevent errors like seen on http://netfrag.org/cgi-bin/viewcvs.cgi/joko/virtual/joko_mail/ + +o update www.netfrag.org + x HomePage (phpWiki::Index): remove yakka's "to be repaired" - line + o Overview: add link to DocumentIndex at section 'Documentation' + x update links (jonen's docs/software, etc.) + o rename http://netfrag.org/docs/build/ to http://netfrag.org/docs/.build/ or http://netfrag.org/docs/@build/ + o rename http://netfrag.org/docs/topics/caesar/ to http://netfrag.org/docs/topics/sysadmin/ ??? + x add new items to sections + x update/enhance news-section (Overview, Details) + +o run broken-link-finder on www.netfrag.org + -> find nice project! + +o infra for www.netfrag.org + o make this shortcut possible: http://netfrag.org/Overview + +o account for jonen@www.netfrag.org--phpWiki::* + +o twingle: + render 'o' and/or 'x' symbols as checkboxes other users can use to enable/prioritize tasks + +o backup eagle.netfrag.org!!! + +o enhance backup-system + LookAt::http://www.netfrag.org/webnews/article.php?id=320&group=nfo.links.computing + +o LookAt = MIME-compliant multi-glass + +o at note/attachment to documents shown via browser to inform user about backups made + (link to backup-locations/-urls) + +o search::admintools before actually starting a ToolHierarchy|ToolTree + +o http://www.netfrag.org/~joko/computing/overview/topics/SampleTasks/joko_2003-01.html + Torus::Publish::ReWeb <-> Torus::Publish::ResearchWeb ??? + +o search::IMAPFilter + +o QoS for apt-get!!! (http or ftp to x.debian.org or uni-erlangen.de (parse /etc/apt/sources.list!!!))