--- joko/doc/SampleTasks/joko_2003-01.html 2003/01/25 01:33:46 1.25 +++ joko/doc/SampleTasks/joko_2003-01.html 2003/01/28 11:03:26 1.81 @@ -1,8 +1,40 @@ + + joko's sample notes - 2003-01 - InventoryCleanupAndRefactoring + + +
 
+
+
+ +AIMS: + - Convert this document into a data-structure and back. + - Don't loose a bit of information. + - Make possible to link to all resources available. + +for working with it + - global metadata + - cvs-loginfo/commitinfo + - ItemMetadata + - ItemStatus (open, closed and stuff) + - ItemAuthor + - ItemType + - ItemIdentifier + - references/associations to/from + - word metadata + - link to target + - show target as ... + - overview of all gathered metadata (at the bottom) + +for rendering it + - render at as [in ] [to this ] + +
+ joko@netfrag.org - sample stack: o [task by joko] introduced "dispatchmail" to add mail2news-functionality to "recieveMail" (collector@netfrag.org) @@ -430,11 +462,26 @@ x /etc/init.d/apache reload x test: http://news.netfrag.org/ - - o new module for cvs-repository? - o nfo/layouts/fs/skel/data + o nfo/layouts/fs/skel/data2 o checkout to /data on quepasa.netfrag.org + x done: + x su root + x cd /var/lib/cvs + x mkdir -p nfo/layouts/fs/skel/data + x mkdir -p nfo/layouts/fs/skel/data2 + x mkdir -p nfo/hosts/quepasa.netfrag.org/data + x cvs -d /var/lib/cvs checkout -d /data nfo/hosts/quepasa.netfrag.org/data + x *mungle everything and commit!* look at the repository! + x add special group with access to this repository: 'rootsrc' + x groupadd rootsrc + x usermod -G src,staff,rootsrc joko + x usermod -G src,staff,rootsrc jonen + x usermod -G rootsrc root + x change permissions + x cd /var/lib/cvs/nfo/ + x chown -R .rootsrc hosts + x chmod -R g+w hosts x add to system-conf-repository: @@ -547,13 +594,600 @@ x sysadmin@netfrag.org x faq@netfrag.org +x --rework|*reworked*-- apache-layout - check into repository as something root is responsible for! + +x --setup|*setting up*-- newsportal (by Florian Amrhein) + x url: http://florian-amrhein.de/newsportal/ + x cd /home/service/download + x mkdir newsportal + x cd newsportal + x wget http://florian-amrhein.de/newsportal/download/newsportal-0.24.tar.gz + x mkdir -p /data/www/virtual/netfrag/sites/news/apps/newsportal/ + x tar -xzf newsportal-0.24.tar.gz --directory=/data/www/global/apps/newsportal/ + x add to /data/www/virtual/netfrag/conf/applications.conf + Alias /webnews/ /data/www/global/apps/newsportal/ + x configure in /data/www/global/apps/newsportal/config.inc + // newsserver setup + $server="news.netfrag.org"; + $server_auth_user="webnews"; + $server_auth_pass="web123"; + x add to /etc/news/nnrp.access: + # 2003-01-26, joko + *:Read Post:webnews:web123:* + x modify groups.txt + + o TODO: AUTOUPDATE here! + x add to the index-page: + xR set INSERTION="" + x grep -rin " + doc/faq.html:4: + doc/history.txt:234:- fehlender Tag ergaenzt + doc/readme-english.html:4: + doc/history.txt~:233:- fehlender Tag ergaenzt + extras/frames/thread_frameset.php:10: + head.inc:5: + x cvs add head.inc + x cvs commit -m "+ initial commit" head.inc + x + x nano head.inc + x STRG+W + T: 5 + xR + xR + x STRG+O + [ENTER] + x test: http://www.netfrag.org/webnews/> + o TODO: RefactorThisHtmlRef to WebNews + o view message in some MimeViewer or HtmlViewer (Horde?) + o -> use a MessageViewer with MimeCapabilities and HtmlCapabilities + x Why newsportal and no other? + x directly connects to nntp-daemon + x has local spool (o TODO: purge regularly?) + x highly customizable + x added custom css-stylesheet and changed something at content-rendering-level without any problems + x visit cvs.netfrag.org to look at the changes made to the newsportal codebase: + x -> newsportal at cvs.netfrag.org + o TODO: RefactorThisLink + x it's just easy! + x setup dispatchrequest for http://news.netfrag.org + x cd /data/www/virtual/netfrag/sites/news/ + x create symlink + x ./.symlinkrc + x copy over from webcvs + x cp ../webcvs/index.php . + x mkdir .dispatch + x cd .dispatch + x cp ../webcvs/.dispatch/config.php . + x cp ../webcvs/.dispatch/index.php . + x cvs add ... + x cvs commit ... + x added|*adding* dispatcher at http://news.netfrag.org + x used and mungled DispatchRequest(->cvs, ->doc, ->search) for this purpose + o IdeaFor ParseDoc: expand: cvs=JumpToCvs, doc=JumpToDoc, search=SearchFor + x examples for the JumpToCvs mechanism are shown on dev@netfrag.org + x no forbidden modules (do this via unix permissions!) + x allow tarball generation? yes! + x Hint: add "Alias /viewcvs/ /usr/share/viewcvs/" to /etc/apache/conf/httpd.conf for online documents and icons + x added to '/data/www/virtual/netfrag/conf/applications.conf' in our case + x added '' to '/etc/viewcvs/templates/header.ezt' + +o rendering *proposals* for TaviWorkflow + o Linking|Referencing (WikiWords, PureExplicitLinkExtrapolation, NamedLinks) + o Coloring + o [o=red, x=green, R=red, r=green] + +o *shortcut*: TestApache to run 'apachectl configtest' (WikiForSystemAdministration) + +x web-based newsreader? twig! + x apt-get install twig + +o shutdown horde (for now: "pause") + +o viewcvs & apache-mod-python? + +o home2web, .home2webrc + o what? + --before: buildhtml --source=pod|tavi + --after: say "ready" + o hmmm... + o buildhtml: automate various SubTasks + o synccvs (->cvs.nfo.perl.scripts.shortcuts.synccvs.pl) + o buildhtml (->makedoc) (->cvs.nfo.perl.scripts.shortcuts.synccvs.pl) + +x added root of quepasa to cvs + x su root + x cd /var/lib/cvs/nfo/hosts/quepasa.netfrag.org + x mkdir root + x chown -R .rootsrc root/ + x chmod -R g+w root/ + x cd /tmp + x cvs -d /var/lib/cvs checkout -d / nfo/hosts/quepasa.netfrag.org/root + x start with /etc + x cd /etc + x cvs add etc + x cvs add viewcvs + x cd viewcvs + x cvs add .... + x cvs commit -m "+ initial commit" + +x How to get a single file from cvs for download: (e.g.) + wget http://cvs.sourceforge.net/cgi-bin/viewcvs.cgi/*checkout*/viewcvs/viewcvs/templates/header.ezt?rev=1.2 + +x cvsgraph still missing: apt-get install cvsgraph + +x chora -> viewcvs + o change logo at /usr/share/viewcvs/images + x removed from template + x cvsview-query.cgi didn't work yet! + x error was: + x tail -f /data/www/virtual/netfrag/log/error_log + Traceback (most recent call last): + File "/usr/lib/cgi-bin/viewcvs-query.cgi", line 50, in ? + import query + File "/usr/lib/python2.1/viewcvs/query.py", line 42, in ? + import cvsdb + File "/usr/lib/python2.1/viewcvs/cvsdb.py", line 34, in ? + import dbi + File "/usr/lib/python2.1/viewcvs/dbi.py", line 17, in ? + import MySQLdb + ImportError: No module named MySQLdb + [Sat Jan 25 11:16:55 2003] [error] [client 217.231.127.85] Premature end of script headers: /usr/lib/cgi-bin/viewcvs-query.cgi + x solution is: + x apt-get install python-mysqldb + x use mysql; + x insert into db values ('localhost', 'ViewCVS', 'viewcvs', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y'); + x insert into db values ('%', 'ViewCVS', 'viewcvs', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y'); + x insert into user (host, user, password) values ('localhost', 'viewcvs', password('viewcvs')); + x flush privileges; + x cd /usr/lib/viewcvs + x ./make-database + x + o mail to author of viewcvs + + +o docu about uml and filesystem-layer running on gharb for MiniHowTo? + +o search.php?wiki=1&cvs=1&index=1 + +o get mnoGoSearch running + e apt-get install mnoGoSearch + +o it's not tavi nor tavi-workflow - it's: JustWrite? it's todo! (.todo -> .justdo -> .justwrite -> .done) + +o ScanToWeb + +o look at Mailman: http://www.list.org/features.html + +o use cvsup!? + +o alien.netfrag.org - (package-conversion) --> alien.packages.netfrag.org + +o chora2viewcvs - How to migrate from Horde/Chora to viewcvs. + +o LinuxInCvs (linux2cvs) + +o TestApacheConfig, StopApache, StartApache have to work without any running Apache - of course! + +o through "viewcvs" we loose the ability to "publish" documents via former chora: + viewcvs takes care to keep documents like they are in their original - so ".html"-files should be shown with text/plain + +o re-integrate .cvslink/JumpToCvs with dispatchurl + +o WikiWords in CvsCommitMessages? (via yakka?) + +x http://cvs.netfrag.org/bareface/yakka/?tarball=1 + +o [source:/link/to/source-code] (most times a '.cvslink' - hmmm?) + [source:] + +o HelpMe + +o [snapshot:/link/to/snapshot] + [snapshot:] + +o dispatchrequest - a multipurpose request dispatcher + o integrate: + x redirector at cvs.netfrag.org ... + o ... and news.netfrag.org + o JumpToCvs (.cvslink-mechanism) + o how was it done? + x cd /data/www/virtual/netfrag/sites/webcvs/.dispatch + x ln -s /data/www/global/apps/dispatchrequest . + + +o buildhtml -> makedoc + +o TWIG & yakka? + +o rename: dispatchmail -> dispatchmessage + +c rename: dispatchrequest -> forwardrequest? + +o readrc of bashrc|perlrc|xmlrc + +x setup TWIG + x cd /usr/share/doc/twig + x cd /data/www/virtual/netfrag/conf/ + x nano applications.conf + x add line: Alias /twig/ /usr/share/twig/ + x had to modify /etc/apache/conf/httpd.conf: + x added: 'index.php3' + + DirectoryIndex index.html index.htm index.shtml index.cgi index.php index.php3 + + x added: '.php3' + AddType application/x-httpd-php .php .php3 + x /etc/init.d/apache reload + x cd /etc/twig + x modify config.inc.php3 + x cd /usr/share/twig/setup + x mysql + x use mysql + x insert into user (host, user, password) values ('localhost', 'www-data', password('')); + x insert into db values ('localhost', 'twig', 'www-data', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y'); + x create database twig; + x flush privileges; + x database-schema + x gunzip twig.table.mysql.gz + x mysql twig < twig.table.mysql + +x setup arbitrary packet and bind to csm-system (Collaborative Software Management) + x pinstall twig + x apt-get install twig + x cd /etc + x cvs add twig + x cd twig + x cvs add * + x cvs add .htaccess + x cvs commit -m "+ initial commit" + + +o remove html from phpWiki: ('http://'!!!) (->https!!!) + + + + +o force https for: (authentication purposes - anonymous is http!) + o horde + o tutos + +x dpkg -x twig_2.7.5-4_all.deb tmp/ + +o TWIG & OpenLDAP!? + +x ApacheMasterLayoutRefactoring: quepasa.netfrag.org: + x removed /data/www/doc to /data/www/global/apps + x test: + x cd /data/www/virtual + x grep -ri "/data/www/doc" * + x cd /data/www/global + x grep -ri "/data/www/doc" * + x apps/twiki/ + x lib/TWiki.cfg + x bin/.htaccess + x conf/twiki-httpd + ---> just change between 'global' and (e.g.) 'virtual/netfrag' for switching between scopes ;-) + ---> the container (folder)-structure at global and sub-virtual level must match almost exactly to make this possible!!!!! + x conf/virtualdomains-httpd/ + x doc/twiki/ + x removed: /data/www/virtual/netfrag/pub to /data/www/virtual/netfrag/sites/public + x cd virtual/netfrag/conf + x grep -ri "/pub" * + x modify httpd.conf and applications.conf + x apachectl configtest + Syntax error on line 345 of /etc/apache/httpd.conf: + DocumentRoot must be a directory + x disabled there completely + x now in /data/www/global/conf/httpd.conf + DocumentRoot /data/www/virtual/netfrag/sites/public + x apachectl configtest + fopen: No such file or directory + apache: could not open document config file /data/www/conf/twiki-httpd.conf + x mv /data/www/global/conf/twiki-httpd.conf /data/www/virtual/netfrag/conf/ + x nano /data/www/virtual/netfrag/conf/applications.conf to match new path + x apachectl configtest + fopen: No such file or directory + apache: could not open document config file /data/www/conf/tutos-httpd.conf + x cd virtual/netfrag + x grep -rin "www/conf" * + x edit applications.conf:21 + x was: Include /data/www/conf/tutos-httpd.conf + x is: Include /data/www/global/conf/tutos-httpd.conf + x apachectl configtest + Warning: DocumentRoot [/data/www/virtual/netfrag/sites/webnews] does not exist + fopen: No such file or directory + apache: could not open document config file /data/www/conf/dynamic.conf + x grep -rin webnews * + x edit applications.conf:30 + x was: Alias /webnews/ /data/www/global/apps/newsportal/ + x is: Alias /webnews/ /data/www/global/apps/newsportal/ + x edit httpd.conf:74 + x was: DocumentRoot /data/www/virtual/netfrag/sites/webnews + x is: DocumentRoot /data/www/virtual/netfrag/sites/news + x cd global/conf + x grep -rin www/conf * + x STDOUT-PARSE: + httpd.conf:14:#Include /data/www/conf/httpd-php-perl.conf + httpd.conf:16:#Include /data/www/conf/virtualdomains-httpd.conf + httpd.conf:29:Include /data/www/conf/dynamic.conf + ->FILE-MODIFY: httpd.conf:29:Include /data/www/global/conf/dynamic.conf + x apachectl configtest + root@quepasa:/data/www/global/conf# apachectl configtest + configuring dynamic domain "golf5.de" + configuring dynamic domain "smartmen.de" + configuring dynamic domain "ballonflug.de" + Syntax OK + x /etc/init.d/apache restart + x testing "http://netfrag.org/" fails + x testing "http://netfrag.org/index.php" + x makes redirect to "http://netfrag.org/nfoweb/" but fails there + x tail -f tail -f /data/www/virtual/netfrag/log/error_log + [Sun Jan 26 15:32:04 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/ + [Sun Jan 26 15:33:02 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/ + [Sun Jan 26 16:37:37 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/ + [Sun Jan 26 16:38:08 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/ + [Sun Jan 26 16:40:10 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/ + + +o register: + public.netfrag.org -> http://netfrag.org + secure.netfrag.org -> https://netfrag.org + +o netfrag.org: DispatchRequest for http://netfrag.org/nfoweb/! +o netfrag.org: DispatchRequest for http://netfrag.org/rrr/! + +o IntroduceMergePoint at http://netfrag.org/doc/ + o MiniHowto + o faqs (e.g. from news://news.netfrag.org/nfo.faq.users + +o what about an "AUTOSAVE"-feature for UltraEdit when leaving the window or + o an AUTOCOMMIT on that very event (maybe integrated with a counter) + +o write scripts to iterate recursively through directories under specified path ... + o ... and do some actions on each directory, e.g. + o execute some specified .dot-files (e.g. .pod2htmlrc, .symlinkrc, .makedocrc) + +x CVSSpam in action: + 10146 ? S 0:00 /usr/sbin/sshd + 10148 ? S 0:00 /usr/sbin/sshd + 10149 ? S 0:00 cvs server + 10150 ? S 0:00 cvs server + 10151 ? S 0:00 /bin/login + 10155 ? S 0:00 /usr/bin/ruby -w /var/lib/cvs/CVSROOT/collect_diffs.rb --to joko@netfrag + 10158 ? S 0:00 /usr/bin/ruby /var/lib/cvs/CVSROOT/cvsspam.rb /tmp/#cvs.loginfo.10149.10 + +x as Chora'sStylesheet has come active (by accident) when viewing this file view web + we should include this as a fixed default making horde our default stylesheet delivery engine (for now) + +o link-checker for netfrag.org + +o dispatcher for style.netfrag.org redirecting to ? + o styleme.php + o brandme.php + + + +o mini-howto: "HttpRedirect" + +o how to refactor the MiniHowtos? + o into a wiki? wikis seem to miss offline/distributed capabilities! (for now) + x into pod + x build offline + o build online + o into DocBook? + o into tavi? (or "TaviWorkflow"?) + o but: LinkWithWikiAutomagically to get everything together + o look at the InterwikiMechanism + o look at the various WikiPluginArchitectures + o look at YakkaDev! + +o a LinkageExample: RenderThis(html4|text|html3|pdf) with [[yakka]] and [[tavi-workflow]]! + o this could mean: + o use the declared formats as output filters for viewing target in other formats / styles + +o proposal for hierarchical structure (and HomePage) of netfrag.org + ~overview -> SomeWiki -> Overview + ~projects (include some common text here) + ~users (include some common text here) + - Page: UserArea + - Page: ~users + ~projects -> SomeWiki-> Projects + ~users (include former page "User area" (now UserArea) automagically at the bottom here! (WikiInclude?)) + ~rabit (raBit's router - psl.no-ip.com) + ~natraj (sam's place - optix) + ~joko (joko's) + ~bareface (->yakka) + +o MasterWorkflow: + -> TheThreeGoodThings + -> HaveIdea -> WriteDown (RefactorLater) -> WriteDownMore -> WriteDownAssociations -> WriteDownEvenMoreIfNotStoppedByExternalInfluences + -> RefactorIdeas -> Categorize -> AddNotes -> AddTasks + -> DoThings -> ReadTasks -> DoTasks + -> TheFourthBadThing: TimeTrackAllThis ;-) (it seems to be not so far away....) + +o what do we need / what do we do? + --- researcher + o OnlineReading + (o SelectItemsForDownload) <- want-to-have + (o DownloadItems) <- want-to-have + --- researcher + o OfflineReading + x ClumsyOfflineReading <- status-quo + (o NiceOfflineReading) <- want-to-have + (o OfflineArchiving) <- want-to-have + o OfflineEditing (text, html, pod, tavi) + o OnlinePublishing () + --- engine + o LiveDispatching (ContentEncoding, ContentConversion, EnvelopeEncapsulation, GatewayToXyz) + o OfflineRendering (html, text, pdf, chm) + --- reader + o OnlineReading () + (o SelectItemsForDownload) <- want-to-have + (o DownloadItems) <- want-to-have + o OfflineReading (pdf, chm) + +o link to http://teamsonar.no-ip.com + +o mail announces to announce@netfrag.org + +o no symlinks in webroot anymore? use ApacheAliases? + +o MiniHowto: NfoLinkageSystem(->news.nfo.announce) + o this declaration could mean: + o UseResources: + o look up "NfoLinkageSystem" as subject in newsgroup "news.nfo.announce" on default newsserver + o RenderThisWay: + o embed into document - html3 + o embed into document - dhtml (ExpandTree, CollapseTree) + o LinkToIt (JumpToMechanism(->minihowto)) + +o php: appcontrol: reads .appcontrolrc-files recursively from directories and adds/removes users or sets passwords + according to specification in there + +o source-code parser which creates documentation with wiki techniques + o pod2tavi -> tavi2html + o phpDoc <- tavi-plugin? + +o integrate yakka and newsportal: + o make a yakka-page of embedded news-articles / threads / thread-parts (a NewsComposition) (->YakkaPageMetadata) + o article-sources + o all items from one news-server + o !!! from different news-servers !!! + o add a "CommentThis"-links to each item when rendering + o when user posts the answer on YakkaEditPage + o make yakka post to the article's associated news-server (read from YakkaItemMetadata) + o wait until new article is published, then ... + o ... add to NewsComposition (update YakkaPageMetadata) (->AsynchronousBackendDaemon) + o ... use/introduce a MetaItem "New" into YakkaPageMetadata (at TopLevel) + which shows NewItems(->self, ->live) per thread or newsgroup + +o download this and that - e.g.: + o phpMyadmin(->archive.software.phpMyAdmin) + o this requires 'archive.software' to have ... + o ... a ListSearchHandler (searches nodelist below 'archive.software' only) + o ... a RecursiveSearchHandler (searches nodelist below 'archive.software' and all subfolders recursively) + o make this available as a ResourceHandler via a DispatchRequest sitting at + o http://netfrag.org/archive/?base=software&search=phpMyAdmin + o http://archive.netfrag.org/ + +x rename newsgroup nfo.csm to nfo.caesar (Collaborative And Easy System Management) + x ctlinnd newgroup nfo.caesar + x /etc/init.d/inn stop + x cd /var/spool/news/nfo + x cp csm/* caesar/ + x cd caesar + (x movearticle ...) + o chown news.news * + o /usr/lib/news/bin/makehistory + x THIS FAILED! DON'T DO IT + +o MiniHowto: KerberizedSystem (->~jonen) + +o RefWords -> LookUpDb -> SearchDb + +x added first news-article which refers/references to another one in another newsgroup + Requirement: LDAP For Aliases, Maps, And Classes + o PARSER-TODO: RefactorThisLink + +o check out /usr/sbin/checksecurity - what's that? + x seems to come from /etc/cron.daily/standard + +o write mail to the KroupwareMailingList + +o ContentIndexer for netfrag.org which should provide a FullTextSearch over AllResources + +o run MakeDoc at interval at netfrag.org as ServiceUser + o implement first version of makedoc + o use mkDoc.bat (or similar) for that purpose + o extend: use 'makedoc.bat|.pl' from ->cvs.joko.TestArea.topics.authoring.DocBook + +o DispatchRequest to tie all together + o just make a ref from almost everything and see what comes in.... + o write handlers for the various refs.... + +o show foldername in CVSSpam - message + +o SoWhyCommands? + o JustUseHumanLanguage! + o StartWithEnglish + o TryGerman + +o wrappers around the common used cvs commands + o cvscheckout + o cvsupdate + o cvscommit + +o newsportal + feature-idea: crosspost to another group + +o FreeTaskManagement + +o run-dotfiles -R fetchdoc|synccvs|makedoc + +o netfrag.org: "NewItems" (interacting with user's cookie's) + +o phpLdapAdmin + o use Horde's Ldap-driver! + o tryout http://www.enaliath.com/phpLDAPadmin.tgz + +o david-addons (Freeware) + +o MacOsX (Shareware) + +o POE - mailing-list??? + +o publish all ldap-schemas seperately + +o copyright information for nfo/docs/schemas (horde & janosch) + +

-$Id: joko_2003-01.html,v 1.25 2003/01/25 01:33:46 joko Exp $ +$Id: joko_2003-01.html,v 1.81 2003/01/28 11:03:26 joko Exp $