| 1 |
@sequence meta |
| 2 |
@title joko's sample notes - 2003-03 - ResourceIntegration |
| 3 |
@subtitle ResourceIntegration II |
| 4 |
@topic joko's Tasks |
| 5 |
@author joko@netfrag.org |
| 6 |
@document-mime-type text/plain |
| 7 |
@document-mime-type text/english text/german |
| 8 |
@document-mime-type text/vnd.twingle |
| 9 |
|
| 10 |
@sequence meta |
| 11 |
@document-history |
| 12 |
@cvs-info |
| 13 |
$Id: joko_2003-03.twingle,v 1.11 2003/03/08 04:55:46 joko Exp $ |
| 14 |
$Log: joko_2003-03.twingle,v $ |
| 15 |
Revision 1.11 2003/03/08 04:55:46 joko |
| 16 |
+ AUTOCOMMIT: updated/added content |
| 17 |
|
| 18 |
Revision 1.10 2003/03/07 22:26:20 joko |
| 19 |
+ AUTOCOMMIT: updated/added content |
| 20 |
|
| 21 |
Revision 1.9 2003/03/07 20:56:02 joko |
| 22 |
+ AUTOCOMMIT: updated/added content |
| 23 |
|
| 24 |
Revision 1.8 2003/03/07 18:26:17 joko |
| 25 |
+ AUTOCOMMIT: updated/added content |
| 26 |
|
| 27 |
Revision 1.7 2003/03/07 17:56:46 joko |
| 28 |
+ AUTOCOMMIT: updated/added content |
| 29 |
|
| 30 |
Revision 1.6 2003/03/07 16:56:42 joko |
| 31 |
+ AUTOCOMMIT: updated/added content |
| 32 |
|
| 33 |
Revision 1.5 2003/03/07 15:57:11 joko |
| 34 |
+ AUTOCOMMIT: updated/added content |
| 35 |
|
| 36 |
Revision 1.4 2003/03/07 04:25:54 joko |
| 37 |
+ AUTOCOMMIT: updated/added content |
| 38 |
|
| 39 |
Revision 1.3 2003/03/07 03:56:59 joko |
| 40 |
+ AUTOCOMMIT: updated/added content |
| 41 |
|
| 42 |
Revision 1.2 2003/03/07 00:56:08 joko |
| 43 |
+ AUTOCOMMIT: updated/added content |
| 44 |
|
| 45 |
Revision 1.1 2003/03/06 22:34:20 joko |
| 46 |
+ initial commit |
| 47 |
|
| 48 |
|
| 49 |
@sequence meta |
| 50 |
@x-transport |
| 51 |
@x-transport-from grasshopper.netfrag.org |
| 52 |
@x-transport-to quepasa.netfrag.org |
| 53 |
@x-transporter Microsoft Windows |
| 54 |
@x-transporter WinCVS [WinCVS 1.3.8.1 Beta 8 (Build 1)] |
| 55 |
@x-transporter-protocol cvs client-server protocol |
| 56 |
@x-transporter OpenSSH client on grasshopper [OpenSSH_3.4p1, SSH protocols 1.5/2.0, OpenSSL 0x0090607f] |
| 57 |
@x-transporter-protocol ssh [OpenSSH Version 2] |
| 58 |
@x-transporter OpenSSH daemon on quepasa [OpenSSH_3.4p1 Debian 1:3.4p1-1, SSH protocols 1.5/2.0, OpenSSL 0x0090603f] |
| 59 |
@x-transporter cvs [Concurrent Versions System (CVS) 1.11.1p1 (client/server)] |
| 60 |
@x-transporter-protocol cvs client-server protocol |
| 61 |
@x-transporter Linux running on quepasa.netfrag.org [Linux version 2.4.18-29um (root@linux) (gcc version 2.95.3 20010315 (SuSE)) #1 Sun May 26 17:01:48 CEST 2002] |
| 62 |
@x-transporter-protocol ext3 |
| 63 |
@x-transporter Linux running on h1.service.netfrag.org [Linux version 2.4.10-4GB (root@Pentium.suse.de) (gcc version 2.95.3 20010315 (SuSE)) #1 Tue Sep 25 12:33:54 GMT 2001] |
| 64 |
@x-transporter-protocol ext3 |
| 65 |
#@x-converter twingle [Twingle 0.01 - http://search.netfrag.org/twingle] |
| 66 |
|
| 67 |
@sequence script |
| 68 |
@set o=@todo |
| 69 |
|
| 70 |
|
| 71 |
|
| 72 |
@sequence block |
| 73 |
@injected |
| 74 |
@date 2003-03-06 20:29 |
| 75 |
@file [unknown] |
| 76 |
@x-editor Notepad [Microsoft Editor Version 5.0 (Build 2195: Service Pack 3) |
| 77 |
@x-transporter Microsoft COM |
| 78 |
@x-transporter-protocol copy & paste negotiation |
| 79 |
@x-editor UltraEdit [UltraEdit(r)-32 Professional Text/HEX Editor Version 8.10b] |
| 80 |
|
| 81 |
|
| 82 |
o use arial|verdana for netscape|mozilla rendering on netfrag.org |
| 83 |
|
| 84 |
- We get spam! |
| 85 |
After feeling relatively safe through amavis based email filtering, it happened again. |
| 86 |
jonen recieved some spam again. |
| 87 |
|
| 88 |
Why? |
| 89 |
I believe the addresses get collected by foreign agents crawling |
| 90 |
the growing content on netfrag.org. |
| 91 |
|
| 92 |
What todo now? |
| 93 |
Mungle email addresses published on netfrag.org through some lisp- |
| 94 |
or scheme-based address-mungler found recently. |
| 95 |
They stay rfc-compliant, but are (hopefully) unreachable for common |
| 96 |
regex parsers. |
| 97 |
Send info to ->jonen. |
| 98 |
@tbd Automate this task! Do you wanna rewrite each address by hand...??? |
| 99 |
|
| 100 |
o personal requirement: |
| 101 |
o daily: review contributions made by other users |
| 102 |
o requirement to solve this: have everything as rss/rdf and filter the xml by author |
| 103 |
|
| 104 |
o rss.netfrag.org (register) |
| 105 |
o establish some web-based rss-browser embedding content from |
| 106 |
o RssGenerators for local content ... |
| 107 |
o news//rss (for news.netfrag.org) |
| 108 |
o cvs//rss (for cvs.netfrag.org) |
| 109 |
o ... and RssGateways to other ones, possibly at remote locations |
| 110 |
o phpWiki//rss (for www.netfrag.org) |
| 111 |
o TWiki//rss (for future www.netfrag.org) |
| 112 |
|
| 113 |
o post to perl-development (nfo.dev.perl): |
| 114 |
o how to abstract the view/editing of xml-files via an api? |
| 115 |
o fetch: all|single-node |
| 116 |
o edit: single-node flattened into an object |
| 117 |
o browser layer: locator registry (pointing to a) an orm-db and b) to a file-set of xml-files (our control-db)) |
| 118 |
o item layer: view/edit nodes of an xml-file a) in a tree-editor (look at HTML_Tree_XYZ itself!!!) and |
| 119 |
b) split into our "flat-components" Item and List (object-like) |
| 120 |
|
| 121 |
how b)? solve in backend! |
| 122 |
o backend |
| 123 |
o change values containing references to their interpolated placeholders to convert a node to an item |
| 124 |
->getNode(...) |
| 125 |
example: getNode('root') |
| 126 |
o place querying api via XPath parallel to that -> also returns a single node or multiples (a node-set) |
| 127 |
->getNodeSet(...) |
| 128 |
example: getNodeSet('xpath-query|named-filter') |
| 129 |
o establish backend querying api for xml-documents on top of that! |
| 130 |
->sendQuery(...) should dispatch to one of ->getNode or ->getNodeSet |
| 131 |
o frontend |
| 132 |
o browse relations (parent-, child-node) using the ValueInterpolator and the ItemComponent |
| 133 |
o edit Attributes and Content of Nodes with the ItemComponent showing *two* areas (this is the "FlatteningOfNodes"): |
| 134 |
o -> attributes |
| 135 |
o -> content |
| 136 |
That's the way various XML-EasyTree-Xyz implementations use to work. |
| 137 |
@link http://www.cpan.org/ |
| 138 |
o frontend issues these generic rpc-commands to the backend (encapsulated somewhere) |
| 139 |
o ->sendQuery(array(remote=1, rpc=1, blah=1, $query )) - |
| 140 |
which gets dispatched by switching some stuff from "$query" to these methods under the hood (in fact, *implemented at backend side*) |
| 141 |
o ->getNodeSet('xpath-query|named-filter') |
| 142 |
example: |
| 143 |
$xml_filter_query = array( 'return' => 'object|object-set', [filter => 'xpath-query|named-filter'] ); |
| 144 |
(speak: Item or List) |
| 145 |
sendQuery(array(remote=1, rpc=1, blah=1, $xml_filter_query , xml=1??? )) - |
| 146 |
|
| 147 |
--> what is 'remote' and/or 'rpc' about??? |
| 148 |
if i remember that right - 'remote' means 'orm' (the datasource-type) and 'rpc' means 'rpc' (the transport-type) |
| 149 |
|
| 150 |
o new twingle-symbol-topology using ... |
| 151 |
<code> |
| 152 |
o ... @-tags (stolen from JavaDoc via phpDocumentor) |
| 153 |
o @-tags only refer to scopes they live in |
| 154 |
o make the basic work: @todo, @link, @see, etc. (but enhanced - of course - since perl doesn't limit you in any way....!!!) |
| 155 |
o add some more: @sequence, @is-a, @title |
| 156 |
o @see |
| 157 |
o @embed this-and-that from these .twingle files: |
| 158 |
o @link DummyNamespaces in PHP - final proposal.twingle |
| 159 |
o @link Re - Namespaces in PHP.twingle |
| 160 |
</code> |
| 161 |
|
| 162 |
o project-metadata: / nfo topics |
| 163 |
<code> |
| 164 |
@is-a rfc |
| 165 |
@todo tbd |
| 166 |
x @topic source(cvs) |
| 167 |
x @topic doc(api) |
| 168 |
o @topic source(raw) (via symlinks: expand directories first, symlink files afterwards!) |
| 169 |
o @topic doc(tutorial) |
| 170 |
o @topic doc(examples) |
| 171 |
o @topic doc(howto) |
| 172 |
o introduce: @subtopic: |
| 173 |
@topic source |
| 174 |
@subtopic raw|cvs |
| 175 |
@topic doc |
| 176 |
@subtopic api|tutorial|examples|howto |
| 177 |
</code> |
| 178 |
|
| 179 |
o register: api.netfrag.org |
| 180 |
|
| 181 |
o arcor!!! |
| 182 |
|
| 183 |
o working alpha version of "Ts" on new server niu!!! |
| 184 |
|
| 185 |
o .phpdocrc: split main code to module, integrate index-generation of predefined (registered) modules |
| 186 |
|
| 187 |
o RssNewsletter: |
| 188 |
o schedule |
| 189 |
o hourly, daily, weekly, monthly, on-incoming |
| 190 |
o choose topic |
| 191 |
o all topics (cvs, news, api, docs, www) |
| 192 |
o choose destination |
| 193 |
o filtered-rss made available at specified url as xml or xhtml |
| 194 |
o via email |
| 195 |
o archived in archive-type (zip|tar) with format (html|) |
| 196 |
made available at specified url |
| 197 |
|
| 198 |
o look at FreeBSD's "doscmd"!!! |
| 199 |
|
| 200 |
o mechanism to refactor old smtp-mail-messages into new nntp-news-posts |
| 201 |
all our tools fail! *forwarding* the message seems to break mime (for e.g. the mozilla-viewer and probably others) |
| 202 |
o possible solution: strip "--- forwarded by ---" - header before actually posting |
| 203 |
maybe identifiable by subject: [Fwd: ] |
| 204 |
|
| 205 |
o enhance Twingle: |
| 206 |
o twingle2message: |
| 207 |
o twingle2mail: twingle2rfc822, twingle2mime |
| 208 |
o twingle2news: twingle2rfc |
| 209 |
|
| 210 |
o gather version info from installed components: |
| 211 |
o CPAN |
| 212 |
o PEAR |
| 213 |
x GNU: <program> --version (e.g.: cvs --version) |
| 214 |
x OpenSSH: ssh -V |
| 215 |
x Linux: cat /proc/version |
| 216 |
o our Perl-/PHP- component system |
| 217 |
|
| 218 |
|
| 219 |
|
| 220 |
@sequence block |
| 221 |
@written |
| 222 |
@date 2003-03-06 |
| 223 |
@x-editor UltraEdit [UltraEdit(r)-32 Professional Text/HEX Editor Version 8.10b] |
| 224 |
|
| 225 |
o what are the MIME-types of XML-payloads sent between (e.g.) RPCXML-hosts??? |
| 226 |
text/xml??? |
| 227 |
|
| 228 |
look at /etc/mime.types!!! |
| 229 |
e.g.: (stripped from there) - looking interesting: |
| 230 |
|
| 231 |
text/* |
| 232 |
text/x-java |
| 233 |
text/uri-list |
| 234 |
text/rfc822-headers |
| 235 |
text/directory |
| 236 |
text/vnd.IPTC.NewsML |
| 237 |
text/vnd.IPTC.NITF |
| 238 |
text/vnd.motorola.reflex |
| 239 |
text/vnd.DMClientScript |
| 240 |
text/richtext |
| 241 |
text/rtf |
| 242 |
text/plain |
| 243 |
text/comma-seperated-values |
| 244 |
text/css |
| 245 |
text/enriched |
| 246 |
|
| 247 |
--> vnd=vendor??? |
| 248 |
|
| 249 |
@sequence references |
| 250 |
@title The text/enriched MIME Content-type |
| 251 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1896.html |
| 252 |
@title Mechanisms for Specifying and Describing the Format of Internet Message Bodies |
| 253 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1521.html |
| 254 |
@title The text/enriched MIME Content-type |
| 255 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1523.html |
| 256 |
@title Mechanisms for Specifying and Describing the Format of Internet Message Bodies |
| 257 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1341.html |
| 258 |
@title The text/enriched MIME Content-type |
| 259 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1563.html |
| 260 |
|
| 261 |
message/delivery-status |
| 262 |
message/disposition-notification |
| 263 |
message/external-body |
| 264 |
message/http |
| 265 |
message/s-http |
| 266 |
message/news |
| 267 |
message/partial |
| 268 |
message/rfc822 |
| 269 |
|
| 270 |
inode/chardevice |
| 271 |
inode/blockdevice |
| 272 |
inode/directory-locked |
| 273 |
inode/directory |
| 274 |
inode/fifo |
| 275 |
inode/socket |
| 276 |
|
| 277 |
multipart/* |
| 278 |
|
| 279 |
o refactor some twingle tags using ETF: |
| 280 |
@link http://citeseer.nj.nec.com/borenstein94textenriched.html |
| 281 |
--- snip --- |
| 282 |
@misc{ borenstein-textenriched, |
| 283 |
author = "N. Borenstein", |
| 284 |
title = "The text/enriched MIME Content-type", |
| 285 |
url = "citeseer.nj.nec.com/borenstein94textenriched.html" } |
| 286 |
--- snip --- |
| 287 |
|
| 288 |
o re-enable yakka! |
| 289 |
@link http://netfrag.org/~bareface/yakka/ |
| 290 |
|
| 291 |
o search.netfrag.org |
| 292 |
o enable mnoGoSearch to index http://www.netfrag.org/docs/code/api/ |
| 293 |
|
| 294 |
o post xml-via-rpc-querying proposal from above to nfo.dev.perl and cc to jonen! |
| 295 |
|
| 296 |
o enhancement for Twingle AutoLink LinkInterpolation: |
| 297 |
o don't resolve namespace identifiers (e.g. 'Data::Storage') against |
| 298 |
global search.netfrag.org/Search::This::Namespace |
| 299 |
o query namespaced links against an organization-wide (custom) NamespaceRegistry before!!! |
| 300 |
o use mysql/Tangram? |
| 301 |
o use xml? |
| 302 |
o just fallback to "GlobalSerchMode" if nothing was found in the step before! |
| 303 |
o Data::Storage will directly be resolved to this url or tag afterwards: |
| 304 |
@link http://www.netfrag.org/docs/topics/perl-libs/Data-Storage.html |
| 305 |
and not to |
| 306 |
@link http://www.netfrag.org/search/?q=Data::Storage&o=1&ul=/ |
| 307 |
like it was before! |
| 308 |
|
| 309 |
o mimic the functionality of TLTP (The LDAP Trigger Process) by using Data::Rap. |
| 310 |
|
| 311 |
o applications to be solved using LDAP |
| 312 |
o organization-wide addressbook |
| 313 |
o global / per-app software component registry |
| 314 |
o organization-wide item library -> inventory |
| 315 |
|
| 316 |
dot http://www.nc.ihost.com/ -> IBM |
| 317 |
|
| 318 |
@topic EasyAuthoring |
| 319 |
@see sdf |
| 320 |
@see text/enriched |
| 321 |
@see ETF |
| 322 |
@see WPP |
| 323 |
@link http://the.sunnyspot.org/wpp/index.html |
| 324 |
|
| 325 |
@company Watchfire |
| 326 |
@topic centrally located site integrity management software |
| 327 |
@link http://www.watchfire.com/ |
| 328 |
|
| 329 |
o look at brian finley's "Storage" article series at http://hpc.devchannel.org/ !!! |
| 330 |
|
| 331 |
- f-prot error on quepasa.netfrag.org: |
| 332 |
root@quepasa:~# tail -f /var/log/mail.log |
| 333 |
--- snip --- |
| 334 |
Mar 7 18:23:30 quepasa amavis[20705]: Virus scanner failure: /usr/local/f-prot/f-prot (error code: 1) |
| 335 |
Mar 7 18:23:30 quepasa amavis[20705]: virus_scan FAILED, retry: All virus scanners failed! at /usr/sbin/amavisd line 933, <GEN9> line 4712. |
| 336 |
Mar 7 18:23:30 quepasa amavis[20705]: mail processing failed, RETRY/TEMPFAIL |
| 337 |
Mar 7 18:23:30 quepasa sm-mta[20758]: h27HLveE020758: Milter: data, reject=451 4.7.1 Please try again later |
| 338 |
--- snip --- |
| 339 |
root@quepasa:~# /usr/local/f-prot/f-prot |
| 340 |
Error: SIGN.DEF is damaged or incompatible with this version of F-PROT. |
| 341 |
root@quepasa:~# /usr/local/f-prot/check-updates.sh |
| 342 |
root@quepasa:~# /usr/local/f-prot/f-prot |
| 343 |
|
| 344 |
|
| 345 |
|
| 346 |
@sequence block |
| 347 |
@injected |
| 348 |
@date 2003-03-07 19:01 |
| 349 |
@file [unknown] |
| 350 |
@x-editor Notepad [Microsoft Editor Version 5.0 (Build 2195: Service Pack 3) |
| 351 |
@x-transporter Microsoft COM |
| 352 |
@x-transporter-protocol copy & paste negotiation |
| 353 |
@x-editor UltraEdit [UltraEdit(r)-32 Professional Text/HEX Editor Version 8.10b] |
| 354 |
|
| 355 |
@set ->=@see |
| 356 |
|
| 357 |
|
| 358 |
o .phpdocrc: Tie::IxHash |
| 359 |
|
| 360 |
- writing a browser is a complex task |
| 361 |
-> Internet Explorer |
| 362 |
-> KDE xyz |
| 363 |
-> Mozilla |
| 364 |
|
| 365 |
- writing a mailer is a complex task |
| 366 |
-> Microsoft Outlook and (-Express) |
| 367 |
-> KDE (KMail, Kontact, Kolab) |
| 368 |
-> Evolution |
| 369 |
-> Mahogany |
| 370 |
|
| 371 |
|
| 372 |
|
| 373 |
@sequence block |
| 374 |
@written |
| 375 |
@date 2003-03-07 |
| 376 |
|
| 377 |
- janosch: pdf-gateway!? |
| 378 |
|
| 379 |
o setup ->colorize on quepasa.netfrag.org |
| 380 |
|
| 381 |
o refactor DesignPattern::MVC |
| 382 |
o new: @uses instances of classes inherited from the base ones |
| 383 |
DesignPattern::MVC::Model and DesignPattern::MVC::View, where |
| 384 |
- DesignPattern::MVC::Model is-a DesignPattern::Observer::Subject |
| 385 |
- DesignPattern::MVC::View is-a DesignPattern::Observer |
| 386 |
o new: refactor the rules-subsystem to be a ChangeManager |
| 387 |
between Subject and Observer sits a ChangeManager acting as mediator (is-a DesignPattern::Mediator) |
| 388 |
@see http://selab.korea.ac.kr/selab/courses/GoF-patterns/observer.htm |
| 389 |
|
| 390 |
o Twingle! |
| 391 |
o twingle -> dispatchmail (Twingle::Mail) |
| 392 |
o twingle -> twingledoc (Twingle::Doc) |
| 393 |
|
| 394 |
o refactor to "twingled/": |
| 395 |
o http://netfrag.org/~joko/computing/overview/topics/topics/ |
| 396 |
o http://netfrag.org/~joko/computing/overview/topics/SampleTasks/ |
| 397 |
o update http://netfrag.org/~joko/computing/overview/topics/topics.html |
| 398 |
|
| 399 |
x re-enable Yakka |
| 400 |
|
| 401 |
o setup phpDocumentor from cvs |
| 402 |
|
| 403 |
o "subscribe" a Folder (using rss/rdf!) |
| 404 |
|
| 405 |
o Arial (or similar font w/o serifs) for Mozilla! |
| 406 |
|
Parent Directory
| 
Revision Log
