--- joko/doc/SampleTasks/joko_2003-01.html 2003/01/25 14:33:30 1.40 +++ joko/doc/SampleTasks/joko_2003-01.html 2003/01/27 22:33:55 1.77 @@ -1,8 +1,40 @@ +
++ +
+ +AIMS: + - Convert this document into a data-structure and back. + - Don't loose a bit of information. + - Make possible to link to all resources available. + +for working with it + - global metadata + - cvs-loginfo/commitinfo + - ItemMetadata + - ItemStatus (open, closed and stuff) + - ItemAuthor + - ItemType + - ItemIdentifier + - references/associations to/from + - word metadata + - link to target + - show target as ... + - overview of all gathered metadata (at the bottom) + +for rendering it + - renderat as [in ] [to this ] + +
+ joko@netfrag.org - sample stack: o [task by joko] introduced "dispatchmail" to add mail2news-functionality to "recieveMail" (collector@netfrag.org) @@ -430,8 +462,6 @@ x /etc/init.d/apache reload x test: http://news.netfrag.org/ - - o new module for cvs-repository? o nfo/layouts/fs/skel/data2 o checkout to /data on quepasa.netfrag.org @@ -564,16 +594,84 @@ x sysadmin@netfrag.org x faq@netfrag.org -x setup newsportal (by Florian Amrhein) +x --rework|*reworked*-- apache-layout - check into repository as something root is responsible for! + +x --setup|*setting up*-- newsportal (by Florian Amrhein) x url: http://florian-amrhein.de/newsportal/ x cd /home/service/download x mkdir newsportal x cd newsportal x wget http://florian-amrhein.de/newsportal/download/newsportal-0.24.tar.gz x mkdir -p /data/www/virtual/netfrag/sites/news/apps/newsportal/ - x tar -xzf newsportal-0.24.tar.gz --directory=/data/www/virtual/netfrag/sites/news/apps/newsportal/ - -o rework apache-layout - check into repository as something root is responsible for! + x tar -xzf newsportal-0.24.tar.gz --directory=/data/www/global/apps/newsportal/ + x add to /data/www/virtual/netfrag/conf/applications.conf + Alias /webnews/ /data/www/global/apps/newsportal/ + x configure in /data/www/global/apps/newsportal/config.inc + // newsserver setup + $server="news.netfrag.org"; + $server_auth_user="webnews"; + $server_auth_pass="web123"; + x add to /etc/news/nnrp.access: + # 2003-01-26, joko + *:Read Post:webnews:web123:* + x modify groups.txt ++ o TODO: AUTOUPDATE here! + x add to the index-page: + xR set INSERTION="" + x grep -rin " + doc/faq.html:4: + doc/history.txt:234:- fehlender Tag ergaenzt + doc/readme-english.html:4: + doc/history.txt~:233:- fehlender Tag ergaenzt + extras/frames/thread_frameset.php:10: + head.inc:5: + x cvs add head.inc + x cvs commit -m "+ initial commit" head.inc + x + x nano head.inc + x STRG+W + T: 5 + xR + xR + x STRG+O + [ENTER] + x test: http://www.netfrag.org/webnews/> + o TODO: RefactorThisHtmlRef to WebNews + o view message in some MimeViewer or HtmlViewer (Horde?) + o -> use a MessageViewer with MimeCapabilities and HtmlCapabilities + x Why newsportal and no other? + x directly connects to nntp-daemon + x has local spool (o TODO: purge regularly?) + x highly customizable + x added custom css-stylesheet and changed something at content-rendering-level without any problems + x visit cvs.netfrag.org to look at the changes made to the newsportal codebase: + x -> newsportal at cvs.netfrag.org + o TODO: RefactorThisLink + x it's just easy! + x setup dispatchrequest for http://news.netfrag.org + x cd /data/www/virtual/netfrag/sites/news/ + x create symlink + x ./.symlinkrc + x copy over from webcvs + x cp ../webcvs/index.php . + x mkdir .dispatch + x cd .dispatch + x cp ../webcvs/.dispatch/config.php . + x cp ../webcvs/.dispatch/index.php . + x cvs add ... + x cvs commit ... + x added|*adding* dispatcher at http://news.netfrag.org + x used and mungled DispatchRequest(->cvs, ->doc, ->search) for this purpose + o IdeaFor ParseDoc: expand: cvs=JumpToCvs, doc=JumpToDoc, search=SearchFor + x examples for the JumpToCvs mechanism are shown on ' to '/etc/viewcvs/templates/header.ezt' -o rendering proposals for TaviWorkflow +o rendering *proposals* for TaviWorkflow o Linking|Referencing (WikiWords, PureExplicitLinkExtrapolation, NamedLinks) o Coloring o [o=red, x=green, R=red, r=green] -o shortcut: TestApache to run 'apachectl configtest' (WikiForSystemAdministration) +o *shortcut*: TestApache to run 'apachectl configtest' (WikiForSystemAdministration) x web-based newsreader? twig! x apt-get install twig @@ -627,8 +725,13 @@ o viewcvs & apache-mod-python? o home2web, .home2webrc - --before: buildhtml --source=pod|tavi - --after: say "ready" + o what? + --before: buildhtml --source=pod|tavi + --after: say "ready" + o hmmm... + o buildhtml: automate various SubTasks + o synccvs (->cvs.nfo.perl.scripts.shortcuts.synccvs.pl) + o buildhtml (->makedoc) (->cvs.nfo.perl.scripts.shortcuts.synccvs.pl) x added root of quepasa to cvs x su root @@ -714,11 +817,357 @@ x http://cvs.netfrag.org/bareface/yakka/?tarball=1 o [source:/link/to/source-code] (most times a '.cvslink' - hmmm?) + [source: ] + +o HelpMe + +o [snapshot:/link/to/snapshot] + [snapshot: ] + +o dispatchrequest - a multipurpose request dispatcher + o integrate: + x redirector at cvs.netfrag.org ... + o ... and news.netfrag.org + o JumpToCvs (.cvslink-mechanism) + o how was it done? + x cd /data/www/virtual/netfrag/sites/webcvs/.dispatch + x ln -s /data/www/global/apps/dispatchrequest . + + +o buildhtml -> makedoc + +o TWIG & yakka? + +o rename: dispatchmail -> dispatchmessage + +c rename: dispatchrequest -> forwardrequest? + +o readrc of bashrc|perlrc|xmlrc + +x setup TWIG + x cd /usr/share/doc/twig + x cd /data/www/virtual/netfrag/conf/ + x nano applications.conf + x add line: Alias /twig/ /usr/share/twig/ + x had to modify /etc/apache/conf/httpd.conf: + x added: 'index.php3' + + DirectoryIndex index.html index.htm index.shtml index.cgi index.php index.php3 + + x added: '.php3' + AddType application/x-httpd-php .php .php3 + x /etc/init.d/apache reload + x cd /etc/twig + x modify config.inc.php3 + x cd /usr/share/twig/setup + x mysql + x use mysql + x insert into user (host, user, password) values ('localhost', 'www-data', password('')); + x insert into db values ('localhost', 'twig', 'www-data', 'Y','Y','Y','Y','Y','Y','N','Y','Y','Y'); + x create database twig; + x flush privileges; + x database-schema + x gunzip twig.table.mysql.gz + x mysql twig < twig.table.mysql + +x setup arbitrary packet and bind to csm-system (Collaborative Software Management) + x pinstall twig + x apt-get install twig + x cd /etc + x cvs add twig + x cd twig + x cvs add * + x cvs add .htaccess + x cvs commit -m "+ initial commit" + + +o remove html from phpWiki: ('http://'!!!) (->https!!!) + + + + +o force https for: (authentication purposes - anonymous is http!) + o horde + o tutos + +x dpkg -x twig_2.7.5-4_all.deb tmp/ + +o TWIG & OpenLDAP!? + +x ApacheMasterLayoutRefactoring: quepasa.netfrag.org: + x removed /data/www/doc to /data/www/global/apps + x test: + x cd /data/www/virtual + x grep -ri "/data/www/doc" * + x cd /data/www/global + x grep -ri "/data/www/doc" * + x apps/twiki/ + x lib/TWiki.cfg + x bin/.htaccess + x conf/twiki-httpd + ---> just change between 'global' and (e.g.) 'virtual/netfrag' for switching between scopes ;-) + ---> the container (folder)-structure at global and sub-virtual level must match almost exactly to make this possible!!!!! + x conf/virtualdomains-httpd/ + x doc/twiki/ + x removed: /data/www/virtual/netfrag/pub to /data/www/virtual/netfrag/sites/public + x cd virtual/netfrag/conf + x grep -ri "/pub" * + x modify httpd.conf and applications.conf + x apachectl configtest + Syntax error on line 345 of /etc/apache/httpd.conf: + DocumentRoot must be a directory + x disabled there completely + x now in /data/www/global/conf/httpd.conf + DocumentRoot /data/www/virtual/netfrag/sites/public + x apachectl configtest + fopen: No such file or directory + apache: could not open document config file /data/www/conf/twiki-httpd.conf + x mv /data/www/global/conf/twiki-httpd.conf /data/www/virtual/netfrag/conf/ + x nano /data/www/virtual/netfrag/conf/applications.conf to match new path + x apachectl configtest + fopen: No such file or directory + apache: could not open document config file /data/www/conf/tutos-httpd.conf + x cd virtual/netfrag + x grep -rin "www/conf" * + x edit applications.conf:21 + x was: Include /data/www/conf/tutos-httpd.conf + x is: Include /data/www/global/conf/tutos-httpd.conf + x apachectl configtest + Warning: DocumentRoot [/data/www/virtual/netfrag/sites/webnews] does not exist + fopen: No such file or directory + apache: could not open document config file /data/www/conf/dynamic.conf + x grep -rin webnews * + x edit applications.conf:30 + x was: Alias /webnews/ /data/www/global/apps/newsportal/ + x is: Alias /webnews/ /data/www/global/apps/newsportal/ + x edit httpd.conf:74 + x was: DocumentRoot /data/www/virtual/netfrag/sites/webnews + x is: DocumentRoot /data/www/virtual/netfrag/sites/news + x cd global/conf + x grep -rin www/conf * + x STDOUT-PARSE: + httpd.conf:14:#Include /data/www/conf/httpd-php-perl.conf + httpd.conf:16:#Include /data/www/conf/virtualdomains-httpd.conf + httpd.conf:29:Include /data/www/conf/dynamic.conf + ->FILE-MODIFY: httpd.conf:29:Include /data/www/global/conf/dynamic.conf + x apachectl configtest + root@quepasa:/data/www/global/conf# apachectl configtest + configuring dynamic domain "golf5.de" + configuring dynamic domain "smartmen.de" + configuring dynamic domain "ballonflug.de" + Syntax OK + x /etc/init.d/apache restart + x testing "http://netfrag.org/" fails + x testing "http://netfrag.org/index.php" + x makes redirect to "http://netfrag.org/nfoweb/" but fails there + x tail -f tail -f /data/www/virtual/netfrag/log/error_log + [Sun Jan 26 15:32:04 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/ + [Sun Jan 26 15:33:02 2003] [error] [client 217.231.119.195] File does not exist: /data/www/virtual/netfrag/pub/ + [Sun Jan 26 16:37:37 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/ + [Sun Jan 26 16:38:08 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/ + [Sun Jan 26 16:40:10 2003] [error] [client 217.231.119.195] Symbolic link not allowed: /data/www/virtual/netfrag/sites/public/nfoweb/ + + +o register: + public.netfrag.org -> http://netfrag.org + secure.netfrag.org -> https://netfrag.org + +o netfrag.org: DispatchRequest for http://netfrag.org/nfoweb/! +o netfrag.org: DispatchRequest for http://netfrag.org/rrr/! + +o IntroduceMergePoint at http://netfrag.org/doc/ + o MiniHowto + o faqs (e.g. from news://news.netfrag.org/nfo.faq.users + +o what about an "AUTOSAVE"-feature for UltraEdit when leaving the window or + o an AUTOCOMMIT on that very event (maybe integrated with a counter) + +o write scripts to iterate recursively through directories under specified path ... + o ... and do some actions on each directory, e.g. + o execute some specified .dot-files (e.g. .pod2htmlrc, .symlinkrc, .makedocrc) + +x CVSSpam in action: + 10146 ? S 0:00 /usr/sbin/sshd + 10148 ? S 0:00 /usr/sbin/sshd + 10149 ? S 0:00 cvs server + 10150 ? S 0:00 cvs server + 10151 ? S 0:00 /bin/login + 10155 ? S 0:00 /usr/bin/ruby -w /var/lib/cvs/CVSROOT/collect_diffs.rb --to joko@netfrag + 10158 ? S 0:00 /usr/bin/ruby /var/lib/cvs/CVSROOT/cvsspam.rb /tmp/#cvs.loginfo.10149.10 + +x as Chora'sStylesheet has come active (by accident) when viewing this file view web + we should include this as a fixed default making horde our default stylesheet delivery engine (for now) + +o link-checker for netfrag.org + +o dispatcher for style.netfrag.org redirecting to ? + o styleme.php + o brandme.php + + + +o mini-howto: "HttpRedirect" + +o how to refactor the MiniHowtos? + o into a wiki? wikis seem to miss offline/distributed capabilities! (for now) + x into pod + x build offline + o build online + o into DocBook? + o into tavi? (or "TaviWorkflow"?) + o but: LinkWithWikiAutomagically to get everything together + o look at the InterwikiMechanism + o look at the various WikiPluginArchitectures + o look at YakkaDev! + +o a LinkageExample: RenderThis(html4|text|html3|pdf) with [[yakka]] and [[tavi-workflow]]! + o this could mean: + o use the declared formats as output filters for viewing target in other formats / styles + +o proposal for hierarchical structure (and HomePage) of netfrag.org + ~overview -> SomeWiki -> Overview + ~projects (include some common text here) + ~users (include some common text here) + - Page: UserArea + - Page: ~users + ~projects -> SomeWiki-> Projects + ~users (include former page "User area" (now UserArea) automagically at the bottom here! (WikiInclude?)) + ~rabit (raBit's router - psl.no-ip.com) + ~natraj (sam's place - optix) + ~joko (joko's) + ~bareface (->yakka) + +o MasterWorkflow: + -> TheThreeGoodThings + -> HaveIdea -> WriteDown (RefactorLater) -> WriteDownMore -> WriteDownAssociations -> WriteDownEvenMoreIfNotStoppedByExternalInfluences + -> RefactorIdeas -> Categorize -> AddNotes -> AddTasks + -> DoThings -> ReadTasks -> DoTasks + -> TheFourthBadThing: TimeTrackAllThis ;-) (it seems to be not so far away....) + +o what do we need / what do we do? + --- researcher + o OnlineReading + (o SelectItemsForDownload) <- want-to-have + (o DownloadItems) <- want-to-have + --- researcher + o OfflineReading + x ClumsyOfflineReading <- status-quo + (o NiceOfflineReading) <- want-to-have + (o OfflineArchiving) <- want-to-have + o OfflineEditing (text, html, pod, tavi) + o OnlinePublishing () + --- engine + o LiveDispatching (ContentEncoding, ContentConversion, EnvelopeEncapsulation, GatewayToXyz) + o OfflineRendering (html, text, pdf, chm) + --- reader + o OnlineReading ( ) + (o SelectItemsForDownload) <- want-to-have + (o DownloadItems) <- want-to-have + o OfflineReading (pdf, chm) + +o link to http://teamsonar.no-ip.com + +o mail announces to announce@netfrag.org + +o no symlinks in webroot anymore? use ApacheAliases? + +o MiniHowto: NfoLinkageSystem(->news.nfo.announce) + o this declaration could mean: + o UseResources: + o look up "NfoLinkageSystem" as subject in newsgroup "news.nfo.announce" on default newsserver + o RenderThisWay: + o embed into document - html3 + o embed into document - dhtml (ExpandTree, CollapseTree) + o LinkToIt (JumpToMechanism(->minihowto)) + +o php: appcontrol: reads .appcontrolrc-files recursively from directories and adds/removes users or sets passwords + according to specification in there + +o source-code parser which creates documentation with wiki techniques + o pod2tavi -> tavi2html + o phpDoc <- tavi-plugin? + +o integrate yakka and newsportal: + o make a yakka-page of embedded news-articles / threads / thread-parts (a NewsComposition) (->YakkaPageMetadata) + o article-sources + o all items from one news-server + o !!! from different news-servers !!! + o add a "CommentThis"-links to each item when rendering + o when user posts the answer on YakkaEditPage + o make yakka post to the article's associated news-server (read from YakkaItemMetadata) + o wait until new article is published, then ... + o ... add to NewsComposition (update YakkaPageMetadata) (->AsynchronousBackendDaemon) + o ... use/introduce a MetaItem "New" into YakkaPageMetadata (at TopLevel) + which shows NewItems(->self, ->live) per thread or newsgroup + +o download this and that - e.g.: + o phpMyadmin(->archive.software.phpMyAdmin) + o this requires 'archive.software' to have ... + o ... a ListSearchHandler (searches nodelist below 'archive.software' only) + o ... a RecursiveSearchHandler (searches nodelist below 'archive.software' and all subfolders recursively) + o make this available as a ResourceHandler via a DispatchRequest sitting at + o http://netfrag.org/archive/?base=software&search=phpMyAdmin + o http://archive.netfrag.org/ + +x rename newsgroup nfo.csm to nfo.caesar (Collaborative And Easy System Management) + x ctlinnd newgroup nfo.caesar + x /etc/init.d/inn stop + x cd /var/spool/news/nfo + x cp csm/* caesar/ + x cd caesar + (x movearticle ...) + o chown news.news * + o /usr/lib/news/bin/makehistory + x THIS FAILED! DON'T DO IT + +o MiniHowto: KerberizedSystem (->~jonen) + +o RefWords -> LookUpDb -> SearchDb + +x added first news-article which refers/references to another one in another newsgroup + Requirement: LDAP For Aliases, Maps, And Classes + o PARSER-TODO: RefactorThisLink + +o check out /usr/sbin/checksecurity - what's that? + x seems to come from /etc/cron.daily/standard + +o write mail to the KroupwareMailingList + +o ContentIndexer for netfrag.org which should provide a FullTextSearch over AllResources + +o run MakeDoc at interval at netfrag.org as ServiceUser + o implement first version of makedoc + o use mkDoc.bat (or similar) for that purpose + o extend: use 'makedoc.bat|.pl' from ->cvs.joko.TestArea.topics.authoring.DocBook + +o DispatchRequest to tie all together + o just make a ref from almost everything and see what comes in.... + o write handlers for the various refs.... + +o show foldername in CVSSpam - message + +o SoWhyCommands? + o JustUseHumanLanguage! + o StartWithEnglish + o TryGerman + +o wrappers around the common used cvs commands + o cvscheckout + o cvsupdate + o cvscommit + +o newsportal + feature-idea: crosspost to another group + + + +