--- joko/doc/SampleTasks/joko_2003-01.html 2003/01/25 11:03:35 1.35 +++ joko/doc/SampleTasks/joko_2003-01.html 2003/01/27 10:03:31 1.74 @@ -1,8 +1,37 @@ + + joko's sample notes - 2003-01 - InventoryCleanupAndRefactoring + + +
 
+
+AIMS:
+  - Convert this document into a data-structure and back.
+  - Don't loose a bit of information.
+  - Make possible to link to all resources available.
+
+for working with it
+  - global metadata
+    - cvs-loginfo/commitinfo
+  - ItemMetadata
+    - ItemStatus (open, closed and stuff)
+    - ItemAuthor
+    - ItemType
+    - ItemIdentifier
+    - references/associations to/from
+  - word metadata
+    - link to target
+    - show target as ...
+  - overview of all gathered metadata (at the bottom)
+
+for rendering it
+    - render  at  as  [in ] [to this ]
+
+
 joko@netfrag.org - sample stack:
 
   o [task by joko] introduced "dispatchmail" to add mail2news-functionality to "recieveMail" (collector@netfrag.org)
@@ -430,8 +459,6 @@
    x /etc/init.d/apache reload
    x test: http://news.netfrag.org/
    
-   
-
 o new module for cvs-repository?
    o nfo/layouts/fs/skel/data2
    o checkout to /data on quepasa.netfrag.org
@@ -564,16 +591,85 @@
   x sysadmin@netfrag.org
   x faq@netfrag.org
   
-x setup newsportal (by Florian Amrhein)
+x --rework|*reworked*-- apache-layout - check into repository as something root is responsible for!
+
+x --setup|*setting up*-- newsportal (by Florian Amrhein)
   x url: http://florian-amrhein.de/newsportal/
   x cd /home/service/download
   x mkdir newsportal
   x cd newsportal
   x wget http://florian-amrhein.de/newsportal/download/newsportal-0.24.tar.gz
   x mkdir -p /data/www/virtual/netfrag/sites/news/apps/newsportal/
-  x tar -xzf newsportal-0.24.tar.gz --directory=/data/www/virtual/netfrag/sites/news/apps/newsportal/
-
-o rework apache-layout - check into repository as something root is responsible for!
+  x tar -xzf newsportal-0.24.tar.gz --directory=/data/www/global/apps/newsportal/
+  x add to /data/www/virtual/netfrag/conf/applications.conf
+    Alias /webnews/ /data/www/global/apps/newsportal/
+  x configure in /data/www/global/apps/newsportal/config.inc
+    // newsserver setup
+    $server="news.netfrag.org";
+    $server_auth_user="webnews";
+    $server_auth_pass="web123";
+  x add to /etc/news/nnrp.access:
+    # 2003-01-26, joko
+    *:Read Post:webnews:web123:*
+  x modify groups.txt
+    
+    o TODO: AUTOUPDATE here!
+  x add to the index-page: 
+    xR set INSERTION=""
+    x grep -rin "
+      doc/faq.html:4:
+      doc/history.txt:234:- fehlender  Tag ergaenzt
+      doc/readme-english.html:4:
+      doc/history.txt~:233:- fehlender  Tag ergaenzt
+      extras/frames/thread_frameset.php:10:
+      head.inc:5:
+    x cvs add head.inc
+    x cvs commit -m "+ initial commit" head.inc
+    x 
+      x nano head.inc
+      x  STRG+W + T: 5
+      xR  
+      xR 
+      x  STRG+O + [ENTER]
+    x test: http://www.netfrag.org/webnews/>
+      o TODO: RefactorThisHtmlRef to WebNews
+    o view message in some MimeViewer or HtmlViewer (Horde?)
+      o -> use a MessageViewer with MimeCapabilities and HtmlCapabilities
+  x Why newsportal and no other?
+    x directly connects to nntp-daemon
+    x has local spool (o TODO: purge regularly?)
+    x highly customizable
+      x added custom css-stylesheet and changed something at content-rendering-level without any problems
+      x visit cvs.netfrag.org to look at the changes made to the newsportal codebase: 
+        x -> newsportal at cvs.netfrag.org
+          o TODO: RefactorThisLink
+    x it's just easy!
+  x setup dispatchrequest for http://news.netfrag.org
+    x cd /data/www/virtual/netfrag/sites/news/
+    x create symlink
+      x ./.symlinkrc
+    x copy over from webcvs
+      x cp ../webcvs/index.php .
+      x mkdir .dispatch
+      x cd .dispatch
+      x cp ../webcvs/.dispatch/config.php .
+      x cp ../webcvs/.dispatch/index.php .
+    x cvs add ...
+    x cvs commit ...
+  x added|*adding* dispatcher at http://news.netfrag.org
+    x used and mungled DispatchRequest(->cvs, ->doc, ->search)  for this purpose
+      o IdeaFor ParseDoc: expand: cvs=JumpToCvs, doc=JumpToDoc, search=SearchFor
+        x examples for the JumpToCvs mechanism are shown on ' to '/etc/viewcvs/templates/header.ezt'
 
-o rendering proposals for TaviWorkflow
+o rendering *proposals* for TaviWorkflow
   o Linking|Referencing (WikiWords, PureExplicitLinkExtrapolation, NamedLinks)
   o Coloring
     o [o=red, x=green, R=red, r=green]
 
-o shortcut: TestApache to run 'apachectl configtest' (WikiForSystemAdministration)
+o *shortcut*: TestApache to run 'apachectl configtest' (WikiForSystemAdministration)
 
 x web-based newsreader? twig!
   x apt-get install twig
@@ -651,7 +747,7 @@
 
 x cvsgraph still missing: apt-get install cvsgraph
 
-x viewcvs
+x chora -> viewcvs
   o change logo at /usr/share/viewcvs/images
   x removed from template 
   x cvsview-query.cgi didn't work yet!
@@ -675,6 +771,11 @@
       x insert into db values ('%', 'ViewCVS', 'viewcvs', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
       x insert into user (host, user, password) values ('localhost', 'viewcvs', password('viewcvs'));
       x flush privileges;
+    x cd /usr/lib/viewcvs
+    x ./make-database
+  x 
+  o mail to author of viewcvs
+    
 
 o docu about uml and filesystem-layer running on gharb for MiniHowTo?
 
@@ -689,10 +790,362 @@
 
 o look at Mailman: http://www.list.org/features.html
 
+o use cvsup!?
+
+o alien.netfrag.org - (package-conversion)  --> alien.packages.netfrag.org
+
+o chora2viewcvs - How to migrate from Horde/Chora to viewcvs.
+
+o LinuxInCvs (linux2cvs)
+
+o TestApacheConfig, StopApache, StartApache have to work without any running Apache - of course!
+
+o through "viewcvs" we loose the ability to "publish" documents via former chora:
+   viewcvs takes care to keep documents like they are in their original - so ".html"-files should be shown with text/plain
+
+o re-integrate .cvslink/JumpToCvs with dispatchurl
+
+o WikiWords in CvsCommitMessages? (via yakka?)
+
+x http://cvs.netfrag.org/bareface/yakka/?tarball=1
+
+o [source:/link/to/source-code]   (most times a '.cvslink' - hmmm?)
+   [source:]
+
+o HelpMe
+
+o [snapshot:/link/to/snapshot]
+   [snapshot:]
+
+o dispatchrequest - a multipurpose request dispatcher
+  o integrate:
+    x redirector at cvs.netfrag.org ...
+    o ... and news.netfrag.org
+  o JumpToCvs (.cvslink-mechanism)
+  o how was it done?
+    x cd /data/www/virtual/netfrag/sites/webcvs/.dispatch
+    x ln -s /data/www/global/apps/dispatchrequest .
+    
+  
+o buildhtml -> makedoc
+
+o TWIG & yakka?
+
+o rename: dispatchmail -> dispatchmessage
+
+c rename: dispatchrequest -> forwardrequest?
+
+o readrc of bashrc|perlrc|xmlrc
+
+x setup TWIG
+  x cd /usr/share/doc/twig
+  x cd /data/www/virtual/netfrag/conf/
+  x nano applications.conf
+  x add line: Alias /twig/ /usr/share/twig/
+  x had to modify /etc/apache/conf/httpd.conf:
+    x added: 'index.php3'
+        
+            DirectoryIndex index.html index.htm index.shtml index.cgi index.php index.php3
+        
+    x added: '.php3'
+        AddType application/x-httpd-php .php .php3
+    x /etc/init.d/apache reload
+    x cd /etc/twig
+      x modify config.inc.php3
+    x cd /usr/share/twig/setup
+      x mysql
+        x use mysql
+        x insert into user (host, user, password) values ('localhost', 'www-data', password(''));
+        x insert into db values ('localhost', 'twig', 'www-data', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y');
+        x create database twig;
+        x flush privileges;
+      x database-schema
+        x gunzip twig.table.mysql.gz
+        x mysql twig < twig.table.mysql
+        
+x setup arbitrary packet and bind to csm-system (Collaborative Software Management)
+  x pinstall twig
+    x apt-get install twig
+    x cd /etc
+    x cvs add twig
+    x cd twig
+    x cvs add *
+    x cvs add .htaccess
+    x cvs commit -m "+ initial commit"
+  
+
+o remove html from phpWiki: ('http://'!!!) (->https!!!)
+  
+  
+  
+
+o force https for: (authentication purposes - anonymous is http!)
+  o horde
+  o tutos
+  
+x dpkg -x twig_2.7.5-4_all.deb tmp/
+
+o TWIG & OpenLDAP!?
+
+x ApacheMasterLayoutRefactoring: quepasa.netfrag.org:
+  x removed /data/www/doc to /data/www/global/apps
+    x test: 
+      x cd /data/www/virtual
+      x grep -ri "/data/www/doc" *
+      x cd /data/www/global
+        x grep -ri "/data/www/doc" *
+        x apps/twiki/
+          x lib/TWiki.cfg
+          x bin/.htaccess
+        x conf/twiki-httpd
+          ---> just change between 'global' and (e.g.) 'virtual/netfrag' for switching between scopes   ;-)
+          ---> the container (folder)-structure at global and sub-virtual level must match almost exactly to make this possible!!!!!
+        x conf/virtualdomains-httpd/
+        x doc/twiki/
+  x removed: /data/www/virtual/netfrag/pub to /data/www/virtual/netfrag/sites/public
+    x cd virtual/netfrag/conf
+      x grep -ri "/pub" *
+        x modify httpd.conf and applications.conf
+  x apachectl configtest
+    Syntax error on line 345 of /etc/apache/httpd.conf:
+    DocumentRoot must be a directory
+    x disabled there completely
+    x now in /data/www/global/conf/httpd.conf
+      DocumentRoot /data/www/virtual/netfrag/sites/public
+  x apachectl configtest
+    fopen: No such file or directory
+    apache: could not open document config file /data/www/conf/twiki-httpd.conf
+    x mv /data/www/global/conf/twiki-httpd.conf /data/www/virtual/netfrag/conf/
+    x nano /data/www/virtual/netfrag/conf/applications.conf to match new path
+  x apachectl configtest
+    fopen: No such file or directory
+    apache: could not open document config file /data/www/conf/tutos-httpd.conf
+    x cd virtual/netfrag
+    x grep -rin "www/conf" *
+    x edit applications.conf:21
+      x was: Include /data/www/conf/tutos-httpd.conf
+      x is: Include /data/www/global/conf/tutos-httpd.conf
+  x apachectl configtest
+    Warning: DocumentRoot [/data/www/virtual/netfrag/sites/webnews] does not exist
+    fopen: No such file or directory
+    apache: could not open document config file /data/www/conf/dynamic.conf
+    x grep -rin webnews *
+      x edit applications.conf:30
+        x was: Alias /webnews/ /data/www/global/apps/newsportal/
+        x is: Alias /webnews/ /data/www/global/apps/newsportal/
+      x edit httpd.conf:74
+        x was: DocumentRoot /data/www/virtual/netfrag/sites/webnews
+        x is: DocumentRoot /data/www/virtual/netfrag/sites/news
+     x cd global/conf
+     x grep -rin www/conf *
+      x STDOUT-PARSE:
+        httpd.conf:14:#Include /data/www/conf/httpd-php-perl.conf
+        httpd.conf:16:#Include /data/www/conf/virtualdomains-httpd.conf
+        httpd.conf:29:Include /data/www/conf/dynamic.conf
+          ->FILE-MODIFY: httpd.conf:29:Include /data/www/global/conf/dynamic.conf
+  x apachectl configtest
+      root@quepasa:/data/www/global/conf# apachectl configtest
+      configuring dynamic domain "golf5.de"
+      configuring dynamic domain "smartmen.de"
+      configuring dynamic domain "ballonflug.de"
+      Syntax OK
+  x /etc/init.d/apache restart
+  x testing "http://netfrag.org/" fails
+  x testing "http://netfrag.org/index.php"
+    x makes redirect to "http://netfrag.org/nfoweb/" but fails there
+  x tail -f tail -f /data/www/virtual/netfrag/log/error_log
+    [Sun Jan 26 15:32:04 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/
+    [Sun Jan 26 15:33:02 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/
+    [Sun Jan 26 16:37:37 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
+    [Sun Jan 26 16:38:08 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
+    [Sun Jan 26 16:40:10 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/
+
+
+o register:
+  public.netfrag.org -> http://netfrag.org
+  secure.netfrag.org -> https://netfrag.org
+  
+o netfrag.org: DispatchRequest for http://netfrag.org/nfoweb/!
+o netfrag.org: DispatchRequest for http://netfrag.org/rrr/!
+
+o IntroduceMergePoint at http://netfrag.org/doc/
+  o MiniHowto
+  o faqs (e.g. from news://news.netfrag.org/nfo.faq.users
+
+o what about an "AUTOSAVE"-feature for UltraEdit when leaving the window or
+  o an AUTOCOMMIT on that very event (maybe integrated with a counter)
+  
+o write scripts to iterate recursively through directories under specified path ...
+  o ... and do some actions on each directory, e.g.
+  o execute some specified .dot-files (e.g. .pod2htmlrc, .symlinkrc, .makedocrc)
+  
+x CVSSpam in action:
+  10146 ?        S      0:00 /usr/sbin/sshd
+  10148 ?        S      0:00 /usr/sbin/sshd
+  10149 ?        S      0:00 cvs server
+  10150 ?        S      0:00 cvs server
+  10151 ?        S      0:00 /bin/login
+  10155 ?        S      0:00 /usr/bin/ruby -w /var/lib/cvs/CVSROOT/collect_diffs.rb --to joko@netfrag
+  10158 ?        S      0:00 /usr/bin/ruby /var/lib/cvs/CVSROOT/cvsspam.rb /tmp/#cvs.loginfo.10149.10
+  
+x as Chora'sStylesheet has come active (by accident) when viewing this file view web
+   we should include this as a fixed default making horde our default stylesheet delivery engine (for now)
+
+o link-checker for netfrag.org
+
+o dispatcher for style.netfrag.org redirecting to ?
+  o styleme.php
+  o brandme.php
+  
+
+
+o mini-howto: "HttpRedirect"
+
+o how to refactor the MiniHowtos?
+  o into a wiki? wikis seem to miss offline/distributed capabilities! (for now)
+  x into pod
+    x build offline
+    o build online
+  o into DocBook?
+  o into tavi? (or "TaviWorkflow"?)
+  o but: LinkWithWikiAutomagically to get everything together
+    o look at the InterwikiMechanism
+    o look at the various WikiPluginArchitectures
+    o look at YakkaDev!
+
+o a LinkageExample: RenderThis(html4|text|html3|pdf) with [[yakka]] and [[tavi-workflow]]!
+  o this could mean:
+    o use the declared formats as output filters for viewing target in other formats / styles
+
+o proposal for hierarchical structure (and HomePage) of netfrag.org
+  ~overview -> SomeWiki -> Overview
+    ~projects (include some common text here)
+    ~users (include some common text here)
+      - Page: UserArea
+      - Page: ~users
+  ~projects -> SomeWiki-> Projects
+  ~users (include former page "User area" (now UserArea) automagically at the bottom here! (WikiInclude?))
+    ~rabit (raBit's router - psl.no-ip.com)
+    ~natraj (sam's place - optix)
+    ~joko (joko's)
+    ~bareface (->yakka)
+
+o MasterWorkflow:
+  -> TheThreeGoodThings
+    -> HaveIdea -> WriteDown (RefactorLater) -> WriteDownMore -> WriteDownAssociations -> WriteDownEvenMoreIfNotStoppedByExternalInfluences
+    -> RefactorIdeas -> Categorize -> AddNotes -> AddTasks
+    -> DoThings -> ReadTasks -> DoTasks
+  -> TheFourthBadThing: TimeTrackAllThis  ;-)  (it seems to be not so far away....)
+
+o what do we need / what do we do?
+  --- researcher
+    o OnlineReading
+    (o SelectItemsForDownload)  <- want-to-have
+    (o DownloadItems)  <- want-to-have
+  --- researcher
+    o OfflineReading
+    x ClumsyOfflineReading  <- status-quo
+      (o NiceOfflineReading)  <- want-to-have
+      (o OfflineArchiving)  <- want-to-have
+    o OfflineEditing (text, html, pod, tavi)
+    o OnlinePublishing ()
+  --- engine
+    o LiveDispatching (ContentEncoding, ContentConversion, EnvelopeEncapsulation, GatewayToXyz)
+      o OfflineRendering (html, text, pdf, chm)
+  --- reader
+    o OnlineReading ()
+    (o SelectItemsForDownload)  <- want-to-have
+    (o DownloadItems)  <- want-to-have
+    o OfflineReading (pdf, chm)
+
+o link to http://teamsonar.no-ip.com
+
+o mail announces to announce@netfrag.org
+
+o no symlinks in webroot anymore? use ApacheAliases?
+
+o MiniHowto: NfoLinkageSystem(->news.nfo.announce)
+  o this declaration could mean:
+    o UseResources:
+      o look up "NfoLinkageSystem" as subject in newsgroup "news.nfo.announce" on default newsserver
+    o RenderThisWay:
+      o embed into document - html3
+      o embed into document - dhtml (ExpandTree, CollapseTree)
+      o LinkToIt (JumpToMechanism(->minihowto))
+
+o php: appcontrol: reads .appcontrolrc-files recursively from directories and adds/removes users or sets passwords
+    according to specification in there
+
+o source-code parser which creates documentation with wiki techniques
+  o pod2tavi -> tavi2html
+  o phpDoc <- tavi-plugin?
+
+o integrate yakka and newsportal:
+  o make a yakka-page of embedded news-articles / threads / thread-parts (a NewsComposition) (->YakkaPageMetadata)
+    o article-sources
+      o all items from one news-server
+      o !!! from different news-servers !!!
+    o add a "CommentThis"-links to each item when rendering
+    o when user posts the answer on YakkaEditPage
+      o make yakka post to the article's associated news-server (read from YakkaItemMetadata)
+      o wait until new article is published, then ...
+        o ... add to NewsComposition (update YakkaPageMetadata) (->AsynchronousBackendDaemon)
+        o ... use/introduce a MetaItem "New" into YakkaPageMetadata (at TopLevel) 
+          which shows NewItems(->self, ->live) per thread or newsgroup
+  
+o download this and that - e.g.:
+  o phpMyadmin(->archive.software.phpMyAdmin)
+    o this requires 'archive.software' to have ...
+      o ... a ListSearchHandler (searches nodelist below 'archive.software' only)
+      o ... a RecursiveSearchHandler (searches nodelist below 'archive.software' and all subfolders recursively)
+      o make this available as a ResourceHandler via a DispatchRequest sitting at 
+        o http://netfrag.org/archive/?base=software&search=phpMyAdmin
+        o http://archive.netfrag.org/
+
+x rename newsgroup nfo.csm to nfo.caesar (Collaborative And Easy System Management)
+  x ctlinnd newgroup nfo.caesar
+  x /etc/init.d/inn stop
+  x cd /var/spool/news/nfo
+  x cp csm/* caesar/
+  x cd caesar
+  (x movearticle ...)
+  o chown news.news *
+  o /usr/lib/news/bin/makehistory
+  x THIS FAILED! DON'T DO IT
+  
+o MiniHowto: KerberizedSystem (->~jonen)
+
+o RefWords -> LookUpDb -> SearchDb
+
+x added first news-article which refers/references to another one in another newsgroup 
+   Requirement: LDAP For Aliases, Maps, And Classes
+   o PARSER-TODO: RefactorThisLink
+
+o check out /usr/sbin/checksecurity - what's that?
+  x seems to come from /etc/cron.daily/standard
+  
+o write mail to the kroupware - mailing-list
+
+o ContentIndexer for netfrag.org which should provide a FullTextSearch over AllResources
+
+o run MakeDoc at interval at netfrag.org as ServiceUser
+  o implement first version of makedoc
+  o use mkDoc.bat (or similar) for that purpose
+  o extend: use 'makedoc.bat|.pl' from ->cvs.joko.TestArea.topics.authoring.DocBook
+
+o DispatchRequest to tie all together
+  o just make a ref from almost everything and see what comes in....
+  o write handlers for the various refs....
+  
+o show foldername in CVSSpam - message
+
+
+
 

-$Id: joko_2003-01.html,v 1.35 2003/01/25 11:03:35 joko Exp $ +$Id: joko_2003-01.html,v 1.74 2003/01/27 10:03:31 joko Exp $