--- joko/doc/SampleTasks/joko_2003-01.html 2003/01/25 01:33:46 1.25
+++ joko/doc/SampleTasks/joko_2003-01.html 2003/01/27 06:04:22 1.72
@@ -1,8 +1,37 @@
+
+ joko's sample notes - 2003-01 - InventoryCleanupAndRefactoring
+
+
+
+
+AIMS:
+ - Convert this document into a data-structure and back.
+ - Don't loose a bit of information.
+ - Make possible to link to all resources available.
+
+for working with it
+ - global metadata
+ - cvs-loginfo/commitinfo
+ - ItemMetadata
+ - ItemStatus (open, closed and stuff)
+ - ItemAuthor
+ - ItemType
+ - ItemIdentifier
+ - references/associations to/from
+ - word metadata
+ - link to target
+ - show target as ...
+ - overview of all gathered metadata (at the bottom)
+
+for rendering it
+ - render at as [in ] [to this ]
+
+
joko@netfrag.org - sample stack:
o [task by joko] introduced "dispatchmail" to add mail2news-functionality to "recieveMail" (collector@netfrag.org)
@@ -430,11 +459,26 @@
x /etc/init.d/apache reload
x test: http://news.netfrag.org/
-
-
o new module for cvs-repository?
- o nfo/layouts/fs/skel/data
+ o nfo/layouts/fs/skel/data2
o checkout to /data on quepasa.netfrag.org
+ x done:
+ x su root
+ x cd /var/lib/cvs
+ x mkdir -p nfo/layouts/fs/skel/data
+ x mkdir -p nfo/layouts/fs/skel/data2
+ x mkdir -p nfo/hosts/quepasa.netfrag.org/data
+ x cvs -d /var/lib/cvs checkout -d /data nfo/hosts/quepasa.netfrag.org/data
+ x *mungle everything and commit!* look at the repository!
+ x add special group with access to this repository: 'rootsrc'
+ x groupadd rootsrc
+ x usermod -G src,staff,rootsrc joko
+ x usermod -G src,staff,rootsrc jonen
+ x usermod -G rootsrc root
+ x change permissions
+ x cd /var/lib/cvs/nfo/
+ x chown -R .rootsrc hosts
+ x chmod -R g+w hosts
x add to system-conf-repository:
@@ -547,13 +591,547 @@
x sysadmin@netfrag.org
x faq@netfrag.org
+x --rework|*reworked*-- apache-layout - check into repository as something root is responsible for!
+
+x --setup|*setting up*-- newsportal (by Florian Amrhein)
+ x url: http://florian-amrhein.de/newsportal/
+ x cd /home/service/download
+ x mkdir newsportal
+ x cd newsportal
+ x wget http://florian-amrhein.de/newsportal/download/newsportal-0.24.tar.gz
+ x mkdir -p /data/www/virtual/netfrag/sites/news/apps/newsportal/
+ x tar -xzf newsportal-0.24.tar.gz --directory=/data/www/global/apps/newsportal/
+ x add to /data/www/virtual/netfrag/conf/applications.conf
+ Alias /webnews/ /data/www/global/apps/newsportal/
+ x configure in /data/www/global/apps/newsportal/config.inc
+ // newsserver setup
+ $server="news.netfrag.org";
+ $server_auth_user="webnews";
+ $server_auth_pass="web123";
+ x add to /etc/news/nnrp.access:
+ # 2003-01-26, joko
+ *:Read Post:webnews:web123:*
+ x modify groups.txt
+
+ o TODO: AUTOUPDATE here!
+ x add to the index-page:
+ xR set INSERTION=""
+ x grep -rin "
+ doc/faq.html:4:
+ doc/history.txt:234:- fehlender Tag ergaenzt
+ doc/readme-english.html:4:
+ doc/history.txt~:233:- fehlender Tag ergaenzt
+ extras/frames/thread_frameset.php:10:
+ head.inc:5:
+ x cvs add head.inc
+ x cvs commit -m "+ initial commit" head.inc
+ x
+ x nano head.inc
+ x STRG+W + T: 5
+ xR
+ xR
+ x STRG+O + [ENTER]
+ x test: http://www.netfrag.org/webnews/>
+ o TODO: RefactorThisHtmlRef to WebNews
+ o view message in some MimeViewer or HtmlViewer (Horde?)
+ o -> use a MessageViewer with MimeCapabilities and HtmlCapabilities
+ x Why newsportal and no other?
+ x directly connects to nntp-daemon
+ x has local spool (o TODO: purge regularly?)
+ x highly customizable
+ x added custom css-stylesheet and changed something at content-rendering-level without any problems
+ x visit cvs.netfrag.org to look at the changes made to the newsportal codebase:
+ x -> newsportal at cvs.netfrag.org
+ o TODO: RefactorThisLink
+ x it's just easy!
+ x setup dispatchrequest for http://news.netfrag.org
+ x cd /data/www/virtual/netfrag/sites/news/
+ x create symlink
+ x ./.symlinkrc
+ x copy over from webcvs
+ x cp ../webcvs/index.php .
+ x mkdir .dispatch
+ x cd .dispatch
+ x cp ../webcvs/.dispatch/config.php .
+ x cp ../webcvs/.dispatch/index.php .
+ x cvs add ...
+ x cvs commit ...
+ x added|*adding* dispatcher at http://news.netfrag.org
+ x used and mungled DispatchRequest(->cvs, ->doc, ->search) for this purpose
+ o IdeaFor ParseDoc: expand: cvs=JumpToCvs, doc=JumpToDoc, search=SearchFor
+ x examples for the JumpToCvs mechanism are shown on dev@netfrag.org
+ x no forbidden modules (do this via unix permissions!)
+ x allow tarball generation? yes!
+ x Hint: add "Alias /viewcvs/ /usr/share/viewcvs/" to /etc/apache/conf/httpd.conf for online documents and icons
+ x added to '/data/www/virtual/netfrag/conf/applications.conf' in our case
+ x added '' to '/etc/viewcvs/templates/header.ezt'
+
+o rendering *proposals* for TaviWorkflow
+ o Linking|Referencing (WikiWords, PureExplicitLinkExtrapolation, NamedLinks)
+ o Coloring
+ o [o=red, x=green, R=red, r=green]
+
+o *shortcut*: TestApache to run 'apachectl configtest' (WikiForSystemAdministration)
+
+x web-based newsreader? twig!
+ x apt-get install twig
+
+o shutdown horde (for now: "pause")
+
+o viewcvs & apache-mod-python?
+
+o home2web, .home2webrc
+ --before: buildhtml --source=pod|tavi
+ --after: say "ready"
+
+x added root of quepasa to cvs
+ x su root
+ x cd /var/lib/cvs/nfo/hosts/quepasa.netfrag.org
+ x mkdir root
+ x chown -R .rootsrc root/
+ x chmod -R g+w root/
+ x cd /tmp
+ x cvs -d /var/lib/cvs checkout -d / nfo/hosts/quepasa.netfrag.org/root
+ x start with /etc
+ x cd /etc
+ x cvs add etc
+ x cvs add viewcvs
+ x cd viewcvs
+ x cvs add ....
+ x cvs commit -m "+ initial commit"
+
+x How to get a single file from cvs for download: (e.g.)
+ wget http://cvs.sourceforge.net/cgi-bin/viewcvs.cgi/*checkout*/viewcvs/viewcvs/templates/header.ezt?rev=1.2
+
+x cvsgraph still missing: apt-get install cvsgraph
+
+x chora -> viewcvs
+ o change logo at /usr/share/viewcvs/images
+ x removed from template
+ x cvsview-query.cgi didn't work yet!
+ x error was:
+ x tail -f /data/www/virtual/netfrag/log/error_log
+ Traceback (most recent call last):
+ File "/usr/lib/cgi-bin/viewcvs-query.cgi", line 50, in ?
+ import query
+ File "/usr/lib/python2.1/viewcvs/query.py", line 42, in ?
+ import cvsdb
+ File "/usr/lib/python2.1/viewcvs/cvsdb.py", line 34, in ?
+ import dbi
+ File "/usr/lib/python2.1/viewcvs/dbi.py", line 17, in ?
+ import MySQLdb
+ ImportError: No module named MySQLdb
+ [Sat Jan 25 11:16:55 2003] [error] [client 217.231.127.85] Premature end of script headers: /usr/lib/cgi-bin/viewcvs-query.cgi
+ x solution is:
+ x apt-get install python-mysqldb
+ x use mysql;
+ x insert into db values ('localhost', 'ViewCVS', 'viewcvs', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
+ x insert into db values ('%', 'ViewCVS', 'viewcvs', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
+ x insert into user (host, user, password) values ('localhost', 'viewcvs', password('viewcvs'));
+ x flush privileges;
+ x cd /usr/lib/viewcvs
+ x ./make-database
+ x
+ o mail to author of viewcvs
+
+
+o docu about uml and filesystem-layer running on gharb for MiniHowTo?
+
+o search.php?wiki=1&cvs=1&index=1
+
+o get mnoGoSearch running
+ e apt-get install mnoGoSearch
+
+o it's not tavi nor tavi-workflow - it's: JustWrite? it's todo! (.todo -> .justdo -> .justwrite -> .done)
+
+o ScanToWeb
+
+o look at Mailman: http://www.list.org/features.html
+
+o use cvsup!?
+
+o alien.netfrag.org - (package-conversion) --> alien.packages.netfrag.org
+
+o chora2viewcvs - How to migrate from Horde/Chora to viewcvs.
+
+o LinuxInCvs (linux2cvs)
+
+o TestApacheConfig, StopApache, StartApache have to work without any running Apache - of course!
+
+o through "viewcvs" we loose the ability to "publish" documents via former chora:
+ viewcvs takes care to keep documents like they are in their original - so ".html"-files should be shown with text/plain
+
+o re-integrate .cvslink/JumpToCvs with dispatchurl
+
+o WikiWords in CvsCommitMessages? (via yakka?)
+
+x http://cvs.netfrag.org/bareface/yakka/?tarball=1
+
+o [source:/link/to/source-code] (most times a '.cvslink' - hmmm?)
+ [source:]
+
+o HelpMe
+
+o [snapshot:/link/to/snapshot]
+ [snapshot:]
+
+o dispatchrequest - a multipurpose request dispatcher
+ o integrate:
+ x redirector at cvs.netfrag.org ...
+ o ... and news.netfrag.org
+ o JumpToCvs (.cvslink-mechanism)
+ o how was it done?
+ x cd /data/www/virtual/netfrag/sites/webcvs/.dispatch
+ x ln -s /data/www/global/apps/dispatchrequest .
+
+
+o buildhtml -> makedoc
+
+o TWIG & yakka?
+
+o rename: dispatchmail -> dispatchmessage
+
+c rename: dispatchrequest -> forwardrequest?
+
+o readrc of bashrc|perlrc|xmlrc
+
+x setup TWIG
+ x cd /usr/share/doc/twig
+ x cd /data/www/virtual/netfrag/conf/
+ x nano applications.conf
+ x add line: Alias /twig/ /usr/share/twig/
+ x had to modify /etc/apache/conf/httpd.conf:
+ x added: 'index.php3'
+
+ DirectoryIndex index.html index.htm index.shtml index.cgi index.php index.php3
+
+ x added: '.php3'
+ AddType application/x-httpd-php .php .php3
+ x /etc/init.d/apache reload
+ x cd /etc/twig
+ x modify config.inc.php3
+ x cd /usr/share/twig/setup
+ x mysql
+ x use mysql
+ x insert into user (host, user, password) values ('localhost', 'www-data', password(''));
+ x insert into db values ('localhost', 'twig', 'www-data', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
+ x create database twig;
+ x flush privileges;
+ x database-schema
+ x gunzip twig.table.mysql.gz
+ x mysql twig < twig.table.mysql
+
+x setup arbitrary packet and bind to csm-system (Collaborative Software Management)
+ x pinstall twig
+ x apt-get install twig
+ x cd /etc
+ x cvs add twig
+ x cd twig
+ x cvs add *
+ x cvs add .htaccess
+ x cvs commit -m "+ initial commit"
+
+
+o remove html from phpWiki: ('http://'!!!) (->https!!!)
+
+
+
+
+o force https for: (authentication purposes - anonymous is http!)
+ o horde
+ o tutos
+
+x dpkg -x twig_2.7.5-4_all.deb tmp/
+
+o TWIG & OpenLDAP!?
+
+x ApacheMasterLayoutRefactoring: quepasa.netfrag.org:
+ x removed /data/www/doc to /data/www/global/apps
+ x test:
+ x cd /data/www/virtual
+ x grep -ri "/data/www/doc" *
+ x cd /data/www/global
+ x grep -ri "/data/www/doc" *
+ x apps/twiki/
+ x lib/TWiki.cfg
+ x bin/.htaccess
+ x conf/twiki-httpd
+ ---> just change between 'global' and (e.g.) 'virtual/netfrag' for switching between scopes ;-)
+ ---> the container (folder)-structure at global and sub-virtual level must match almost exactly to make this possible!!!!!
+ x conf/virtualdomains-httpd/
+ x doc/twiki/
+ x removed: /data/www/virtual/netfrag/pub to /data/www/virtual/netfrag/sites/public
+ x cd virtual/netfrag/conf
+ x grep -ri "/pub" *
+ x modify httpd.conf and applications.conf
+ x apachectl configtest
+ Syntax error on line 345 of /etc/apache/httpd.conf:
+ DocumentRoot must be a directory
+ x disabled there completely
+ x now in /data/www/global/conf/httpd.conf
+ DocumentRoot /data/www/virtual/netfrag/sites/public
+ x apachectl configtest
+ fopen: No such file or directory
+ apache: could not open document config file /data/www/conf/twiki-httpd.conf
+ x mv /data/www/global/conf/twiki-httpd.conf /data/www/virtual/netfrag/conf/
+ x nano /data/www/virtual/netfrag/conf/applications.conf to match new path
+ x apachectl configtest
+ fopen: No such file or directory
+ apache: could not open document config file /data/www/conf/tutos-httpd.conf
+ x cd virtual/netfrag
+ x grep -rin "www/conf" *
+ x edit applications.conf:21
+ x was: Include /data/www/conf/tutos-httpd.conf
+ x is: Include /data/www/global/conf/tutos-httpd.conf
+ x apachectl configtest
+ Warning: DocumentRoot [/data/www/virtual/netfrag/sites/webnews] does not exist
+ fopen: No such file or directory
+ apache: could not open document config file /data/www/conf/dynamic.conf
+ x grep -rin webnews *
+ x edit applications.conf:30
+ x was: Alias /webnews/ /data/www/global/apps/newsportal/
+ x is: Alias /webnews/ /data/www/global/apps/newsportal/
+ x edit httpd.conf:74
+ x was: DocumentRoot /data/www/virtual/netfrag/sites/webnews
+ x is: DocumentRoot /data/www/virtual/netfrag/sites/news
+ x cd global/conf
+ x grep -rin www/conf *
+ x STDOUT-PARSE:
+ httpd.conf:14:#Include /data/www/conf/httpd-php-perl.conf
+ httpd.conf:16:#Include /data/www/conf/virtualdomains-httpd.conf
+ httpd.conf:29:Include /data/www/conf/dynamic.conf
+ ->FILE-MODIFY: httpd.conf:29:Include /data/www/global/conf/dynamic.conf
+ x apachectl configtest
+ root@quepasa:/data/www/global/conf# apachectl configtest
+ configuring dynamic domain "golf5.de"
+ configuring dynamic domain "smartmen.de"
+ configuring dynamic domain "ballonflug.de"
+ Syntax OK
+ x /etc/init.d/apache restart
+ x testing "http://netfrag.org/" fails
+ x testing "http://netfrag.org/index.php"
+ x makes redirect to "http://netfrag.org/nfoweb/" but fails there
+ x tail -f tail -f /data/www/virtual/netfrag/log/error_log
+ [Sun Jan 26 15:32:04 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/
+ [Sun Jan 26 15:33:02 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/
+ [Sun Jan 26 16:37:37 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
+ [Sun Jan 26 16:38:08 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
+ [Sun Jan 26 16:40:10 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
+
+
+o register:
+ public.netfrag.org -> http://netfrag.org
+ secure.netfrag.org -> https://netfrag.org
+
+o netfrag.org: DispatchRequest for http://netfrag.org/nfoweb/!
+o netfrag.org: DispatchRequest for http://netfrag.org/rrr/!
+
+o IntroduceMergePoint at http://netfrag.org/doc/
+ o MiniHowto
+ o faqs (e.g. from news://news.netfrag.org/nfo.faq.users
+
+o what about an "AUTOSAVE"-feature for UltraEdit when leaving the window or
+ o an AUTOCOMMIT on that very event (maybe integrated with a counter)
+
+o write scripts to iterate recursively through directories under specified path ...
+ o ... and do some actions on each directory, e.g.
+ o execute some specified .dot-files (e.g. .pod2htmlrc, .symlinkrc, .makedocrc)
+
+x CVSSpam in action:
+ 10146 ? S 0:00 /usr/sbin/sshd
+ 10148 ? S 0:00 /usr/sbin/sshd
+ 10149 ? S 0:00 cvs server
+ 10150 ? S 0:00 cvs server
+ 10151 ? S 0:00 /bin/login
+ 10155 ? S 0:00 /usr/bin/ruby -w /var/lib/cvs/CVSROOT/collect_diffs.rb --to joko@netfrag
+ 10158 ? S 0:00 /usr/bin/ruby /var/lib/cvs/CVSROOT/cvsspam.rb /tmp/#cvs.loginfo.10149.10
+
+x as Chora'sStylesheet has come active (by accident) when viewing this file view web
+ we should include this as a fixed default making horde our default stylesheet delivery engine (for now)
+
+o link-checker for netfrag.org
+
+o dispatcher for style.netfrag.org redirecting to ?
+ o styleme.php
+ o brandme.php
+
+
+
+o mini-howto: "HttpRedirect"
+
+o how to refactor the MiniHowtos?
+ o into a wiki? wikis seem to miss offline/distributed capabilities! (for now)
+ x into pod
+ x build offline
+ o build online
+ o into DocBook?
+ o into tavi? (or "TaviWorkflow"?)
+ o but: LinkWithWikiAutomagically to get everything together
+ o look at the InterwikiMechanism
+ o look at the various WikiPluginArchitectures
+ o look at YakkaDev!
+
+o a LinkageExample: RenderThis(html4|text|html3|pdf) with [[yakka]] and [[tavi-workflow]]!
+ o this could mean:
+ o use the declared formats as output filters for viewing target in other formats / styles
+
+o proposal for hierarchical structure (and HomePage) of netfrag.org
+ ~overview -> SomeWiki -> Overview
+ ~projects (include some common text here)
+ ~users (include some common text here)
+ - Page: UserArea
+ - Page: ~users
+ ~projects -> SomeWiki-> Projects
+ ~users (include former page "User area" (now UserArea) automagically at the bottom here! (WikiInclude?))
+ ~rabit (raBit's router - psl.no-ip.com)
+ ~natraj (sam's place - optix)
+ ~joko (joko's)
+ ~bareface (->yakka)
+
+o MasterWorkflow:
+ -> TheThreeGoodThings
+ -> HaveIdea -> WriteDown (RefactorLater) -> WriteDownMore -> WriteDownAssociations -> WriteDownEvenMoreIfNotStoppedByExternalInfluences
+ -> RefactorIdeas -> Categorize -> AddNotes -> AddTasks
+ -> DoThings -> ReadTasks -> DoTasks
+ -> TheFourthBadThing: TimeTrackAllThis ;-) (it seems to be not so far away....)
+
+o what do we need / what do we do?
+ --- researcher
+ o OnlineReading
+ (o SelectItemsForDownload) <- want-to-have
+ (o DownloadItems) <- want-to-have
+ --- researcher
+ o OfflineReading
+ x ClumsyOfflineReading <- status-quo
+ (o NiceOfflineReading) <- want-to-have
+ (o OfflineArchiving) <- want-to-have
+ o OfflineEditing (text, html, pod, tavi)
+ o OnlinePublishing ()
+ --- engine
+ o LiveDispatching (ContentEncoding, ContentConversion, EnvelopeEncapsulation, GatewayToXyz)
+ o OfflineRendering (html, text, pdf, chm)
+ --- reader
+ o OnlineReading ()
+ (o SelectItemsForDownload) <- want-to-have
+ (o DownloadItems) <- want-to-have
+ o OfflineReading (pdf, chm)
+
+o link to http://teamsonar.no-ip.com
+
+o mail announces to announce@netfrag.org
+
+o no symlinks in webroot anymore? use ApacheAliases?
+
+o MiniHowto: NfoLinkageSystem(->news.nfo.announce)
+ o this declaration could mean:
+ o UseResources:
+ o look up "NfoLinkageSystem" as subject in newsgroup "news.nfo.announce" on default newsserver
+ o RenderThisWay:
+ o embed into document - html3
+ o embed into document - dhtml (ExpandTree, CollapseTree)
+ o LinkToIt (JumpToMechanism(->minihowto))
+
+o php: appcontrol: reads .appcontrolrc-files recursively from directories and adds/removes users or sets passwords
+ according to specification in there
+
+o source-code parser which creates documentation with wiki techniques
+ o pod2tavi -> tavi2html
+ o phpDoc <- tavi-plugin?
+
+o integrate yakka and newsportal:
+ o make a yakka-page of embedded news-articles / threads / thread-parts (a NewsComposition) (->YakkaPageMetadata)
+ o article-sources
+ o all items from one news-server
+ o !!! from different news-servers !!!
+ o add a "CommentThis"-links to each item when rendering
+ o when user posts the answer on YakkaEditPage
+ o make yakka post to the article's associated news-server (read from YakkaItemMetadata)
+ o wait until new article is published, then ...
+ o ... add to NewsComposition (update YakkaPageMetadata) (->AsynchronousBackendDaemon)
+ o ... use/introduce a MetaItem "New" into YakkaPageMetadata (at TopLevel)
+ which shows NewItems(->self, ->live) per thread or newsgroup
+
+o download this and that - e.g.:
+ o phpMyadmin(->archive.software.phpMyAdmin)
+ o this requires 'archive.software' to have ...
+ o ... a ListSearchHandler (searches nodelist below 'archive.software' only)
+ o ... a RecursiveSearchHandler (searches nodelist below 'archive.software' and all subfolders recursively)
+ o make this available as a ResourceHandler via a DispatchRequest sitting at
+ o http://netfrag.org/archive/?base=software&search=phpMyAdmin
+ o http://archive.netfrag.org/
+
+x rename newsgroup nfo.csm to nfo.caesar (Collaborative And Easy System Management)
+ x ctlinnd newgroup nfo.caesar
+ x /etc/init.d/inn stop
+ x cd /var/spool/news/nfo
+ x cp csm/* caesar/
+ x cd caesar
+ (x movearticle ...)
+ o chown news.news *
+ o /usr/lib/news/bin/makehistory
+ x THIS FAILED! DON'T DO IT
+
+o MiniHowto: KerberizedSystem (->~jonen)
+
+o RefWords -> LookUpDb -> SearchDb
+
+x added first news-article which refers/references to another one in another newsgroup
+ Requirement: LDAP For Aliases, Maps, And Classes
+ o PARSER-TODO: RefactorThisLink
+
+o check out /usr/sbin/checksecurity - what's that?
+ x seems to come from /etc/cron.daily/standard
+
-$Id: joko_2003-01.html,v 1.25 2003/01/25 01:33:46 joko Exp $
+$Id: joko_2003-01.html,v 1.72 2003/01/27 06:04:22 joko Exp $