--- joko/doc/SampleTasks/joko_2003-03.twingle 2003/03/15 01:25:53 1.99 +++ joko/doc/SampleTasks/joko_2003-03.twingle 2003/03/18 03:56:00 1.119 @@ -10,7 +10,7 @@ @sequence meta @document-history @cvs-info - $Id: joko_2003-03.twingle,v 1.99 2003/03/15 01:25:53 joko Exp $ + $Id: joko_2003-03.twingle,v 1.119 2003/03/18 03:56:00 joko Exp $ Revision 1.93 2003/03/14 14:55:57 joko @@ -599,9 +599,16 @@ o from (e.g. test6/) o to (e.g. test6/zoomed/) -o global "last-recent-error"-page for admin to view errors occouring - ->SystemErrors - ->StepProcessing: ./.runrc: update|build|publish +x global "last-recent-error"-page for admin to view errors occouring + - SystemErrors + o /var/log/syslog + x root-mails (via nntp-news-msg's: Alerts/nfo.support) + x netsaint + x monit + - StepProcessing: ./.runrc: update|build|publish + - phpDocumentor-errors + o monitor regularly: http://netfrag.org/docs/code/api/org.netfrag/errors.html + x by now: linked manually in 'caesar': http://h1.service.netfrag.org/caesar/ o clean up disks!!! o h1.service.netfrag.org @@ -609,8 +616,6 @@ o natraj/sorceress: server-consolidation? -o monitor regularly: http://netfrag.org/docs/code/api/org.netfrag/errors.html - o DataSource::Generic <-> ObjectList!!! o Yakka: (javascript-control): @@ -656,8 +661,6 @@ o ->search.netfrag.org/ruby -o install and use 'monit' to monitor uml's! - o refactor Yakka::YakkaSetup o quepasa - Error: AMaViS @@ -844,7 +847,38 @@ o /home/uml/skels aufräumen! o draw more diagrams o let 'monit' monitor our umls - - together with heartbeat! + x install and configure 'monit' + - ... some libs and stuff to be installed on suse .... + - /etc/monitrc (not /etc/monit.conf!!!) + - requires to be a true file: + monit: The control file '/etc/monitrc' must not be a symbolic link. + rjoko@h1:/home/service/bin/caesar # cd /etc/ + rjoko@h1:/etc # rm monitrc + rjoko@h1:/etc # mv monit.conf monitrc + - requires to have certain permissions: + monit: The control file '/etc/monitrc' must have permissions no more than -rwx------ (0700); right now permissions are -rw-r--r-- (0644). + rjoko@h1:/etc # chmod a-rwx monitrc + rjoko@h1:/etc # chmod 077 monitrc + - try again: + #> monit + - yup! + x monitoring these services by pid: + o atd.pid + x cron.pid + o gpm.pid + x inetd.pid + o ippl.pid + o klogd.pid + x monit.pid + o nscd.pid + o ntop.sock= + o proftpd/ + o samba/ + x sendmail/ + o smpppd/ + x sshd.pid + x syslogd.pid + o let it work together with heartbeats on umls o make more backups databases: code (repository) and rdbms-sql (mysql) @@ -1038,31 +1072,31 @@ -- intop 0.0.1 (Sep 24 2001) -- The first interactive ntop program. (C) Copyright 2000 L. Deri and R. Carbone. All rights reserved. -o refactor 'estats' on h1.service.netfrag.org - o new design - o new location - o http://h1.service.netfrag.org/~service/estats/ -> http://h1.service.netfrag.org/caesar/ - o new architecture? (use WML - Website Meta Language?) - o new names for services / new hierarchy - o Alerts - o news.netfrag.org/nfo.support - o Accounting - o bw_accounting - o DiskSpaceUsage (dus2html) [new] - o IOGraph - o Monitoring - o Service - o netsaint - o nsa - o monit - o Network - o ip-connection-state (via ippl) - o ip-port-state (via snmpwalk) - o Backup - o netfrag.org/backup/ - o bacula - o Logs - o news.netfrag.org/nfo.support +x refactor 'estats' on h1.service.netfrag.org + x new design + x new location + - http://h1.service.netfrag.org/~service/estats/ -> http://h1.service.netfrag.org/caesar/ + c new architecture? (use WML - Website Meta Language?) + x new names for services / new hierarchy + - Alerts + - news.netfrag.org/nfo.support + - Accounting + - bw_accounting + - DiskSpaceUsage (dus2html) [new] + - IOGraph + - Monitoring + - Service + - netsaint + - nsa + - monit + - Network + - ip-connection-state (via ippl) + - ip-port-state (via snmpwalk) + - Backup + - netfrag.org/backup/ + - bacula + - Logs + - news.netfrag.org/nfo.support x new backend for "Monitoring" replacing... #*/10 * * * * tail -n 100 /var/log/ippl/all.log > /home/service/public_html/misc/ll/connstate/ippl_output.txt #0 0 * * * /home/service/bin/webalizer/mkstats.sh > /dev/null @@ -1073,11 +1107,11 @@ x File::Data x wget http://search.cpan.org/CPAN/authors/id/R/RF/RFOLEY/File-Data-1.12.tar.gz ... established in /home/service/bin/agents/... - x [conns] ippl/recent.pl + x [conns] ippl/recent.pl (running in background) x [procs] pstree/procs (linked to /etc/cron.daily) - x [ports] snmpwalk/getopenports + x [ports] snmpwalk/getopenports (snmpwalk/ports linked to /etc/cron.hourly) -o pdumpfs +i pdumpfs - 2003-03-13 - before Filesystem 1K-blocks Used Available Use% Mounted on /dev/ubd/0 1007896 795632 161064 84% / @@ -1288,3 +1322,162 @@ http://www.netfrag.org/nfoweb/index.php/ReleaseNotes http://phpwiki.sourceforge.net/phpwiki/HISTORY +o look at jabber again! get it running on quepasa.netfrag.org + (for being able to give [jabberzilla|http://jabberzilla.mozdev.org/] a shot) + +x ./mkdiag org.netfrag.glib Class Data DataSource DesignPattern Site + +i + root@quepasa:/data/www/virtual/netfrag/docs/nfo/dia# df -h + Filesystem Size Used Avail Use% Mounted on + /dev/ubd/0 985M 812M 123M 87% / + /dev/ubd/2 2.0G 2.0G 0 100% /data + +o !!!! check if device is full before writing to disk !!!! + +i http://www.gnu.org/projects/dotgnu/index.rdf + +o reasoning from CPU Load to Work Load + +o just traverse the whole file-system one time!!! (*once* a day) + => use the backup-system to generate global ChangeLogs, preferably via rdf/rss + +i apt-get install sourceforge + root@quepasa:/data/www/virtual/netfrag/docs/nfo# apt-get install sourceforge + Reading Package Lists... Done + Building Dependency Tree... Done + The following extra packages will be installed: + bind9 exim ldap-utils libdb4.1 libdbd-pg-perl libdns8 libiodbc2 libisccc0 libisccfg0 libldap2 + libldap2-tls libnss-ldap libpam-ldap libpgtcl libreadline4 mailman perl-suid php4-pgsql postgresql + postgresql-client proftpd proftpd-common python2.2 slapd ucf + The following packages will be REMOVED: + amavis-milter bind ftpd sendmail + The following NEW packages will be installed: + bind9 exim ldap-utils libdb4.1 libdbd-pg-perl libdns8 libiodbc2 libisccc0 libisccfg0 libldap2-tls + libnss-ldap libpam-ldap mailman perl-suid php4-pgsql postgresql proftpd proftpd-common python2.2 slapd + sourceforge ucf + 4 packages upgraded, 22 newly installed, 4 to remove and 258 not upgraded. + Need to get 15.3MB of archives. After unpacking 45.5MB will be used. + Do you want to continue? [Y/n] n + Abort. + +o tex backup!? + +x quepasa didn't accept news-messages: + #> tail -f /var/log/syslog + Mar 17 18:14:11 quepasa innd: localhost:5 closed seconds 0 accepted 0 refused 0 rejected 0 + Mar 17 18:14:11 quepasa rnews: rejected connection 400 No space left on device writing article file -- throttling + #> df + Filesystem 1K-blocks Used Available Use% Mounted on + /dev/ubd/0 1007896 831180 125516 87% / + /dev/ubd/2 2015824 1224076 689348 64% /data + #> /etc/init.d/inn restart + Already throttled + Starting news server: innd. + #> tail -f /var/log/syslog + +o fix dispatchmail to recognize this!!! ( => don't ignore such messages! ) + o make impossible that undelivered messages go to nirvana + o deliver to *one* (by now) special mailbox named 'undelivered' + o introduce web-based message-refactoring / address-redispatching -frontend on top of that! + +o sync "joko--Sent-Mails" against "quepasa--dispatchmail--Recieved-through-Newsgate"-Mails + to have a diff of the messages which didn't receive their target(s) + o maybe addionally check them against returned mails from PostmasterX + +mv http://dillo.cipsga.org.br/ -> http://dillo.auriga.wearlab.de/ + +o i after running SuSEconfig on h1.service.netfrag.org, please do: + #> cd /var/spool + #> chown -R .users mqueue/ + #> chmod g+x mqueue/ + #> chmod -R g+r mqueue/ + +o fsse.netfrag.org (Free Software Search Engine) + +x moved mails from 'trafficreport@hetzner.de' manually to IMAP-Folder 'logs/netfrag.org/system/applications' + o make up script which tries to automagically 'learn' this rule by scanning a mbox-hierarchy [located at Xyz - ;-)] + x same with 'robot@hetzner.de' + +o write some proposals: + o The publishing-layer (sh/perl-scripts) -> dotGNU + o The web-frontend-layer (php-front, perl-backed) -> dotGNU + +o let monit monitor the system-load... is it capable restarting services which actually *do* make the load? + +o phpDocumentIndex:
[scribe|http://www-sop.inria.fr/mimosa/fp/Scribe/] ??? + +o use scribe and mod_scribe for document authoring and publishing + +o commit h1.service.netfrag.org:~service/ to cvs!!! + +o apt-get install scribe??? + x yup! + Reading Package Lists... Done + Building Dependency Tree... Done + The following extra packages will be installed: + bigloo-runtime-2.5c + The following NEW packages will be installed: + bigloo-runtime-2.5c scribe + 0 packages upgraded, 2 newly installed, 0 to remove and 265 not upgraded. + Need to get 3148kB of archives. After unpacking 12.3MB will be used. + Do you want to continue? [Y/n] + Get:1 ftp://ftp.de.debian.org unstable/main bigloo-runtime-2.5c 2.5c-4 [2197kB] + Get:2 ftp://ftp.de.debian.org unstable/main scribe 1.1a+beta.2002.11.02-6 [951kB] + Fetched 3148kB in 3s (851kB/s) + Selecting previously deselected package bigloo-runtime-2.5c. + (Reading database ... 35541 files and directories currently installed.) + Unpacking bigloo-runtime-2.5c (from .../bigloo-runtime-2.5c_2.5c-4_i386.deb) ... + Selecting previously deselected package scribe. + Unpacking scribe (from .../scribe_1.1a+beta.2002.11.02-6_i386.deb) ... + Setting up bigloo-runtime-2.5c (2.5c-4) ... + Setting up scribe (1.1a+beta.2002.11.02-6) ... + +o scribe <-> Autodia??? + +o distributed log-receiver using debian-logtools + +i quepasa.netfrag.org + #> apt-get install splitvt + +o look at gfslicer - A utility to split and join files + http://packages.debian.org/unstable/utils/gfslicer.html + +o gnu@netfrag.org, debian@netfrag.org for posting interesting stuff regarding these topics??? + +o LookAt::ftp://ftp.gnu.org/pub/gnu/dotgnu-pnet/debian/ + +o modules for WebExplorer: + o SchedulerFrontend: creates jobs/metadata for + o cron jobs + o ts backend jobs + o WCron jobs + o DataMapper + o maps entries of a list of key-value pairs to another list (manually or based on rules/constraints) or stuff like that + o JobExecutor (already componentalized - just embed/include) - living at org.netfrag.app--YAA (Yet Another Admin) + +o use monit to prevent amok-runs + +o make up per-host topics for caesar (quepasa, sorceress, helo and elessar, (moonX?)) + +i trace program-run & output + - catch output of: + o phpDocumentor + o Autodia & Autodia-tools + o publish at a new subdirectory + o link to caesar appropriatly + o filter for error-messages (grep -i error), link to different place(s) at caesar + o build index.scr files with scribe pointing to + o api's for different packages (pub/docs) + o log-messages/-errors for different generation programs (caesar/Messages, caesar/Alerts|Errors) +