| 1 |
@sequence meta |
| 2 |
@title joko's sample notes - 2003-03 - ResourceIntegration |
| 3 |
@subtitle ResourceIntegration II |
| 4 |
@topic joko's Tasks |
| 5 |
@author joko@netfrag.org |
| 6 |
@document-mime-type text/plain |
| 7 |
@document-mime-type text/english text/german |
| 8 |
@document-mime-type text/vnd.twingle |
| 9 |
|
| 10 |
@sequence meta |
| 11 |
@document-history |
| 12 |
@cvs-info |
| 13 |
$Id: joko_2003-03.twingle,v 1.2 2003/03/07 00:56:08 joko Exp $ |
| 14 |
$Log: joko_2003-03.twingle,v $ |
| 15 |
Revision 1.2 2003/03/07 00:56:08 joko |
| 16 |
+ AUTOCOMMIT: updated/added content |
| 17 |
|
| 18 |
Revision 1.1 2003/03/06 22:34:20 joko |
| 19 |
+ initial commit |
| 20 |
|
| 21 |
|
| 22 |
@sequence meta |
| 23 |
@x-transport |
| 24 |
@x-transport-from grasshopper.netfrag.org |
| 25 |
@x-transport-to quepasa.netfrag.org |
| 26 |
@x-transporter Microsoft Windows |
| 27 |
@x-transporter WinCVS [WinCVS 1.3.8.1 Beta 8 (Build 1)] |
| 28 |
@x-transporter-protocol cvs client-server protocol |
| 29 |
@x-transporter OpenSSH client on grasshopper [OpenSSH_3.4p1, SSH protocols 1.5/2.0, OpenSSL 0x0090607f] |
| 30 |
@x-transporter-protocol ssh [OpenSSH Version 2] |
| 31 |
@x-transporter OpenSSH daemon on quepasa [OpenSSH_3.4p1 Debian 1:3.4p1-1, SSH protocols 1.5/2.0, OpenSSL 0x0090603f] |
| 32 |
@x-transporter cvs [Concurrent Versions System (CVS) 1.11.1p1 (client/server)] |
| 33 |
@x-transporter-protocol cvs client-server protocol |
| 34 |
@x-transporter Linux running on quepasa.netfrag.org [Linux version 2.4.18-29um (root@linux) (gcc version 2.95.3 20010315 (SuSE)) #1 Sun May 26 17:01:48 CEST 2002] |
| 35 |
@x-transporter-protocol ext3 |
| 36 |
@x-transporter Linux running on h1.service.netfrag.org [Linux version 2.4.10-4GB (root@Pentium.suse.de) (gcc version 2.95.3 20010315 (SuSE)) #1 Tue Sep 25 12:33:54 GMT 2001] |
| 37 |
@x-transporter-protocol ext3 |
| 38 |
#@x-converter twingle [Twingle 0.01 - http://search.netfrag.org/twingle] |
| 39 |
|
| 40 |
@sequence script |
| 41 |
@set o=@todo |
| 42 |
|
| 43 |
|
| 44 |
|
| 45 |
@sequence block |
| 46 |
@injected |
| 47 |
@date 2003-03-06 20:29 |
| 48 |
@file [unknown] |
| 49 |
@x-editor Notepad [Microsoft Editor Version 5.0 (Build 2195: Service Pack 3) |
| 50 |
@x-transporter Microsoft COM |
| 51 |
@x-transporter-protocol copy & paste negotiation |
| 52 |
@x-editor UltraEdit [UltraEdit(r)-32 Professional Text/HEX Editor Version 8.10b] |
| 53 |
|
| 54 |
|
| 55 |
o use arial|verdana for netscape|mozilla rendering on netfrag.org |
| 56 |
|
| 57 |
- We get spam! |
| 58 |
After feeling relatively safe through amavis based email filtering, it happened again. |
| 59 |
jonen recieved some spam again. |
| 60 |
|
| 61 |
Why? |
| 62 |
I believe the addresses get collected by foreign agents crawling |
| 63 |
the growing content on netfrag.org. |
| 64 |
|
| 65 |
What todo now? |
| 66 |
Mungle email addresses published on netfrag.org through some lisp- |
| 67 |
or scheme-based address-mungler found recently. |
| 68 |
They stay rfc-compliant, but are (hopefully) unreachable for common |
| 69 |
regex parsers. |
| 70 |
Send info to ->jonen. |
| 71 |
@tbd Automate this task! Do you wanna rewrite each address by hand...??? |
| 72 |
|
| 73 |
o personal requirement: |
| 74 |
o daily: review contributions made by other users |
| 75 |
o requirement to solve this: have everything as rss/rdf and filter the xml by author |
| 76 |
|
| 77 |
o rss.netfrag.org (register) |
| 78 |
o establish some web-based rss-browser embedding content from |
| 79 |
o RssGenerators for local content ... |
| 80 |
o news//rss (for news.netfrag.org) |
| 81 |
o cvs//rss (for cvs.netfrag.org) |
| 82 |
o ... and RssGateways to other ones, possibly at remote locations |
| 83 |
o phpWiki//rss (for www.netfrag.org) |
| 84 |
o TWiki//rss (for future www.netfrag.org) |
| 85 |
|
| 86 |
o post to perl-development (nfo.dev.perl): |
| 87 |
o how to abstract the view/editing of xml-files via an api? |
| 88 |
o fetch: all|single-node |
| 89 |
o edit: single-node flattened into an object |
| 90 |
o browser layer: locator registry (pointing to a) an orm-db and b) to a file-set of xml-files (our control-db)) |
| 91 |
o item layer: view/edit nodes of an xml-file a) in a tree-editor (look at HTML_Tree_XYZ itself!!!) and |
| 92 |
b) split into our "flat-components" Item and List (object-like) |
| 93 |
|
| 94 |
how b)? solve in backend! |
| 95 |
o backend |
| 96 |
o change values containing references to their interpolated placeholders to convert a node to an item |
| 97 |
->getNode(...) |
| 98 |
example: getNode('root') |
| 99 |
o place querying api via XPath parallel to that -> also returns a single node or multiples (a node-set) |
| 100 |
->getNodeSet(...) |
| 101 |
example: getNodeSet('xpath-query|named-filter') |
| 102 |
o establish backend querying api for xml-documents on top of that! |
| 103 |
->sendQuery(...) should dispatch to one of ->getNode or ->getNodeSet |
| 104 |
o frontend |
| 105 |
o browse relations (parent-, child-node) using the ValueInterpolator and the ItemComponent |
| 106 |
o edit Attributes and Content of Nodes with the ItemComponent showing *two* areas (this is the "FlatteningOfNodes"): |
| 107 |
o -> attributes |
| 108 |
o -> content |
| 109 |
That's the way various XML-EasyTree-Xyz implementations use to work. |
| 110 |
@link http://www.cpan.org/ |
| 111 |
o frontend issues these generic rpc-commands to the backend (encapsulated somewhere) |
| 112 |
o ->sendQuery(array(remote=1, rpc=1, blah=1, $query )) - |
| 113 |
which gets dispatched by switching some stuff from "$query" to these methods under the hood (in fact, *implemented at backend side*) |
| 114 |
o ->getNodeSet('xpath-query|named-filter') |
| 115 |
example: |
| 116 |
$xml_filter_query = array( 'return' => 'object|object-set', [filter => 'xpath-query|named-filter'] ); |
| 117 |
(speak: Item or List) |
| 118 |
sendQuery(array(remote=1, rpc=1, blah=1, $xml_filter_query , xml=1??? )) - |
| 119 |
|
| 120 |
--> what is 'remote' and/or 'rpc' about??? |
| 121 |
if i remember that right - 'remote' means 'orm' (the datasource-type) and 'rpc' means 'rpc' (the transport-type) |
| 122 |
|
| 123 |
o new twingle-symbol-topology using ... |
| 124 |
<code> |
| 125 |
o ... @-tags (stolen from JavaDoc via phpDocumentor) |
| 126 |
o @-tags only refer to scopes they live in |
| 127 |
o make the basic work: @todo, @link, @see, etc. (but enhanced - of course - since perl doesn't limit you in any way....!!!) |
| 128 |
o add some more: @sequence, @is-a, @title |
| 129 |
o @see |
| 130 |
o @embed this-and-that from these .twingle files: |
| 131 |
o @link DummyNamespaces in PHP - final proposal.twingle |
| 132 |
o @link Re - Namespaces in PHP.twingle |
| 133 |
</code> |
| 134 |
|
| 135 |
o project-metadata: / nfo topics |
| 136 |
<code> |
| 137 |
@is-a rfc |
| 138 |
@todo tbd |
| 139 |
x @topic source(cvs) |
| 140 |
x @topic doc(api) |
| 141 |
o @topic source(raw) (via symlinks: expand directories first, symlink files afterwards!) |
| 142 |
o @topic doc(tutorial) |
| 143 |
o @topic doc(examples) |
| 144 |
o @topic doc(howto) |
| 145 |
o introduce: @subtopic: |
| 146 |
@topic source |
| 147 |
@subtopic raw|cvs |
| 148 |
@topic doc |
| 149 |
@subtopic api|tutorial|examples|howto |
| 150 |
</code> |
| 151 |
|
| 152 |
o register: api.netfrag.org |
| 153 |
|
| 154 |
o arcor!!! |
| 155 |
|
| 156 |
o working alpha version of "Ts" on new server niu!!! |
| 157 |
|
| 158 |
o .phpdocrc: split main code to module, integrate index-generation of predefined (registered) modules |
| 159 |
|
| 160 |
o RssNewsletter: |
| 161 |
o schedule |
| 162 |
o hourly, daily, weekly, monthly, on-incoming |
| 163 |
o choose topic |
| 164 |
o all topics (cvs, news, api, docs, www) |
| 165 |
o choose destination |
| 166 |
o filtered-rss made available at specified url as xml or xhtml |
| 167 |
o via email |
| 168 |
o archived in archive-type (zip|tar) with format (html|) |
| 169 |
made available at specified url |
| 170 |
|
| 171 |
o look at FreeBSD's "doscmd"!!! |
| 172 |
|
| 173 |
o mechanism to refactor old smtp-mail-messages into new nntp-news-posts |
| 174 |
all our tools fail! *forwarding* the message seems to break mime (for e.g. the mozilla-viewer and probably others) |
| 175 |
o possible solution: strip "--- forwarded by ---" - header before actually posting |
| 176 |
maybe identifiable by subject: [Fwd: ] |
| 177 |
|
| 178 |
o enhance Twingle: |
| 179 |
o twingle2message: |
| 180 |
o twingle2mail: twingle2rfc822, twingle2mime |
| 181 |
o twingle2news: twingle2rfc |
| 182 |
|
| 183 |
o gather version info from installed components: |
| 184 |
o CPAN |
| 185 |
o PEAR |
| 186 |
x GNU: <program> --version (e.g.: cvs --version) |
| 187 |
x OpenSSH: ssh -V |
| 188 |
x Linux: cat /proc/version |
| 189 |
o our Perl-/PHP- component system |
| 190 |
|
| 191 |
o what are the MIME-types of XML-payloads sent between (e.g.) RPCXML-hosts??? |
| 192 |
text/xml??? |
| 193 |
|
| 194 |
look at /etc/mime.types!!! |
| 195 |
e.g.: (stripped from there) - looking interesting: |
| 196 |
|
| 197 |
text/* |
| 198 |
text/x-java |
| 199 |
text/uri-list |
| 200 |
text/rfc822-headers |
| 201 |
text/directory |
| 202 |
text/vnd.IPTC.NewsML |
| 203 |
text/vnd.IPTC.NITF |
| 204 |
text/vnd.motorola.reflex |
| 205 |
text/vnd.DMClientScript |
| 206 |
text/richtext |
| 207 |
text/rtf |
| 208 |
text/plain |
| 209 |
text/comma-seperated-values |
| 210 |
text/css |
| 211 |
text/enriched |
| 212 |
|
| 213 |
--> vnd=vendor??? |
| 214 |
|
| 215 |
@sequence references |
| 216 |
@title The text/enriched MIME Content-type |
| 217 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1896.html |
| 218 |
@title Mechanisms for Specifying and Describing the Format of Internet Message Bodies |
| 219 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1521.html |
| 220 |
@title The text/enriched MIME Content-type |
| 221 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1523.html |
| 222 |
@title Mechanisms for Specifying and Describing the Format of Internet Message Bodies |
| 223 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1341.html |
| 224 |
@title The text/enriched MIME Content-type |
| 225 |
@link http://www.cis.ohio-state.edu/cgi-bin/rfc/rfc1563.html |
| 226 |
|
| 227 |
message/delivery-status |
| 228 |
message/disposition-notification |
| 229 |
message/external-body |
| 230 |
message/http |
| 231 |
message/s-http |
| 232 |
message/news |
| 233 |
message/partial |
| 234 |
message/rfc822 |
| 235 |
|
| 236 |
inode/chardevice |
| 237 |
inode/blockdevice |
| 238 |
inode/directory-locked |
| 239 |
inode/directory |
| 240 |
inode/fifo |
| 241 |
inode/socket |
| 242 |
|
| 243 |
multipart/* |
| 244 |
|
| 245 |
o refactor some twingle tags using ETF: |
| 246 |
@link http://citeseer.nj.nec.com/borenstein94textenriched.html |
| 247 |
--- snip --- |
| 248 |
@misc{ borenstein-textenriched, |
| 249 |
author = "N. Borenstein", |
| 250 |
title = "The text/enriched MIME Content-type", |
| 251 |
url = "citeseer.nj.nec.com/borenstein94textenriched.html" } |
| 252 |
--- snip --- |
| 253 |
|
| 254 |
o re-enable yakka! |
| 255 |
@link http://netfrag.org/~bareface/yakka/ |
| 256 |
|
| 257 |
o search.netfrag.org |
| 258 |
o enable mnoGoSearch to index http://www.netfrag.org/docs/code/api/ |
| 259 |
|
| 260 |
o post xml-via-rpc-querying proposal from above to nfo.dev.perl and cc to jonen! |
| 261 |
|
| 262 |
o enhancement for Twingle AutoLink LinkInterpolation: |
| 263 |
o don't resolve namespace identifiers (e.g. 'Data::Storage') against |
| 264 |
global search.netfrag.org/Search::This::Namespace |
| 265 |
o query namespaced links against an organization-wide (custom) NamespaceRegistry before!!! |
| 266 |
o use mysql/Tangram? |
| 267 |
o use xml? |
| 268 |
o just fallback to "GlobalSerchMode" if nothing was found in the step before! |
| 269 |
o Data::Storage will directly be resolved to this url or tag afterwards: |
| 270 |
@link http://www.netfrag.org/docs/topics/perl-libs/Data-Storage.html |
| 271 |
and not to |
| 272 |
@link http://www.netfrag.org/search/?q=Data::Storage&o=1&ul=/ |
| 273 |
like it was before! |
| 274 |
|
| 275 |
o mimic the functionality of TLTP (The LDAP Trigger Process) by using Data::Rap. |
| 276 |
|
| 277 |
o applications to be solved using LDAP |
| 278 |
o organization-wide addressbook |
| 279 |
o global / per-app software component registry |
| 280 |
o organization-wide item library -> inventory |
| 281 |
|
| 282 |
dot http://www.nc.ihost.com/ -> IBM |
| 283 |
|
Parent Directory
| 
Revision Log
