Garden

DAV Tiddlywiki home page server side

Sat, 27 Oct 2007 20:08:00 GMT

The rationale of moving /var/www to /home/www is to benefit from system wide mercurial versioning when /var is excluded by /.hgignore.
cmd loic@dachary.org

set -e
meta="$1"
author="$(xmlstarlet sel -t -v /appliance/@author < <(dog no-header $meta))"
app=apache2 ; apt-get install $app && hg addremove && hg commit -u $author -m "apt-get install $app"
app=patch ; apt-get install $app && hg addremove && hg commit -u $author -m "apt-get install $app"
a2enmod dav_fs
touch /var/lock/apache2/DAVLock
mkdir -p /home/www
wget -O /home/www/index.html http://tiddlywiki.com/empty.html
chown -R www-data /var/lock/apache2 /home/www
cd /
patch -p1 'EOF'
a/etc/apache2/sites-available/default Thu May 17 13:04:18 2007 +0200
+++ b/etc/apache2/sites-available/default Thu May 17 13:42:19 2007 +0200
-2,19 +2,20 NameVirtualHost *
<VirtualHost *>
ServerAdmin webmaster@localhost

- DocumentRoot /var/www/
+ DocumentRoot /home/www/
<Directory />
Options FollowSymLinks
AllowOverride None
</Directory>
- <Directory /var/www/>
+ <Directory /home/www/>
Options Indexes FollowSymLinks MultiViews
AllowOverride None
Order allow,deny
allow from all
# This directive allows us to have apache2's default start page
# in /apache2-default/, but still have / go to the right place
- RedirectMatch ^/$ /apache2-default/
+ #RedirectMatch ^/$ /apache2-default/
+ DAV On
</Directory>

ScriptAlias /cgi-bin/ /usr/lib/cgi-bin/

EOF
/etc/init.d/apache2 restart
hg add /home/www
hg commit -m 'DAV Tiddlywiki home page' /home/www /etc/apache2
app=rubygems ; apt-get install $app && hg addremove && hg commit -u $author -m "apt-get install $app"
gem install tiddlywiki_cp
gem install tiddlywiki_cp # cope for gem install lossage, probably because of timeouts poorly handled
rm -f /usr/bin/tiddlywiki_cp
ln -s /var/lib/gems/*/gems/tiddlywiki_cp-*/bin/tiddlywiki_cp /usr/bin/tiddlywiki_cp
mkdir -p /home/www/index
ruby /usr/bin/tiddlywiki_cp 'http://tiddlylab.bidix.info/#WebDAVSavingPlugin' /home/www/index
ruby /usr/bin/tiddlywiki_cp 'http://tiddlywiki.bidix.info/#GenerateRssByTagPlugin' /home/www/index
ruby /usr/bin/tiddlywiki_cp -a /home/www/index /home/www/index.html
chown -R www-data.www-data /home/www/index*
hg addremove
hg commit -u $author -m "install tiddlywiki for home page"

multi user terminal session hacking

Fri, 31 Aug 2007 00:58:00 GMT

installation

app=screen ; author=loic@dachary.org ; apt-get install -y --force-yes $app && hg addremove && hg commit -u $author -m "apt-get install $app"
echo '^]a' > /root/.screenrc

first to join

screen

second to join

screen -x

Summary

Mon, 27 Aug 2007 14:33:00 GMT

Tools and methods to lower the obstacles to modify the bytes in a system (gardening) in a meaningfull way.The purpose of a gardener is to talk, using bytes and processes and to listen to the bytes and processes grown by other people.
The life cycle of bytes starts as a phrase (i.e. a sequence of bytes) which turns into a file, grows as a directory and becomes a software appliance when it starts running software. It will occasionaly hibernate and regress to become a directory with no dedicated software running on top of it or a single file archive that cannot be easily modified.

	phrase	file	directory	software appliance
phrase		cut/paste in a tiddlywiki		vserver
file	N/A		mkdir + tiddlywiki + mercurial + DAV	vserver
directory	N/A	tarbal		vserver
software appliance	N/A	tarbal	rsync /var/lib/vservers/name	rename a vserver

Links

Mon, 27 Aug 2007 14:30:00 GMT

irc://irc.freenode.net/dachary/

Loic Dachary <mailto:loic@dachary.org>
Johan Euphrosine <mailto:proppy@aminche.com>

http://garden.dachary.org/empty.html
http://garden.dachary.org/universe.html
http://garden.dachary.org/tiddlyforge.html

DAV Tiddlywiki home page

Mon, 23 Jul 2007 13:23:00 GMT

DAV Tiddlywiki home page server side
On the client machine add the following in /etc/fstab

echo 'http://versavant.dachary.org /versavant.dachary.org davfs noauto,user,exec 0 0' >> /etc/fstab
mkdir /versavant.dachary.org

As a regular user you can now

mount /versavant.dachary.org

If you don't want to answer the authentication question with empty user/pass each time

perl -pi -e 's/^ask_auth.*/ask_auth 0/' /etc/davfs2/davfs2.conf

move private conversation to a DAV directory

Mon, 23 Jul 2007 13:12:00 GMT

Using gaim
Activate logs of all conversations
Chose to share a private conversation with proppy in a publicly accessible directory

a=$(echo ~/.gaim/logs/yahoo/ldachary/*/$(date '+%Y-%m-%d')*.txt) ; b=$(basename $a) ; cat $a | gpg --recipient proppy@aminche.com --recipient loic@senga.org --encrypt | ssh -p 3022 root@javapoker.pokersource.info "cat > $b.pgp ; hg add ; hg commit -m 'private conversation' ."

fam2rss.dachary.org

Mon, 23 Jul 2007 13:11:00 GMT

grommit and dachary discuss on IRC about fam2rss
grommit starts scripting something on his machine
dachary creates a software appliance
dachary adds the ssh public key of grommit so that he can log in
dachary research the net looking for answers and saves the visited pages in a directory
dachary has better things to do for the next N days/weeks/months

after a while dachary realize that this idea is a degenerate of a broader idea : a versioned file system where the version system provides rss feeds
dachary downgrades the appliance to a directory as per http://garden.dachary.org/universe.html#%5B%5Bdowngrade%20a%20software%20appliance%20to%20a%20directory%5D%5D

poker-network-1-0-37.pokersource.info

Mon, 23 Jul 2007 13:10:00 GMT

dachary is about to release a new version of a poker server
the release changes the protocol, hence the client and the server must be upgraded simultaneously
dachary creates a software appliance to install the new server
the software appliance will be used for testing and for archiving, hence the name carries the version number
dachary grants access to the vserver to mike who is also interested in this new version
mike copies the entire software appliance on his computer and plays with it
dachary is invied to the copy of the software appliance by mike
dachary watches the file modification history and discuss them with mike

Rationale

Fri, 13 Jul 2007 00:36:00 GMT

More often than not, modifying a set of bytes is impossible or very impractical. This is painfull in general and a daily annoyance to the Free Software developer in particular.

How could you modify http://anpe.fr/ to add an index ? How do you become a Debian developer to upload a well formed software package to http://debian.org/ ? How do you fix a bug in the gcc compiler ? Why exciting discussions on IRC lead to nothing ? Why Free Software based persistant universes projects end with great plans, a remarkable burst and slowly freeze ? Why the majority of Free Software projects freeze despite the good will of many ? Why a widely used software is paralyzed and even the most talented developer can't fix a bug ?

A collection of common sense receipes and a selection of technical tool would be very helpfull to improve the process of changing bytes in a continous maner.

Design

Tue, 19 Jun 2007 00:08:00 GMT

The changeset is a unit of communication between processes/functions/appliances.
Keep the number of use cases minimal by finding duplicates or alternate use cases.
Provide pointers to existing tools but don't discuss their implementation in technical terms.
Every byte container should produce a feed of changes.
Not only focus on tools and methods to work in a given context but also on tools and methods that help to change context. From a line on IRC to a specification to an appliance back to a specification with a backup directory because the idea was not so great after all etc..

How do proppy and loic grow bytes

Mon, 18 Jun 2007 23:36:00 GMT

Seed

Think and discuss
Write to friends about the ideas
Insert the text written into a structured document (software specifications as a tiddlywiki or a tiddler)
Imagine a use case
Write the use case
Implement the use case as quickly as possible and record the actions as an implementation
Craft tests or run watchdogs to figure out if the implementation is working
If something cannot be done manually, grow another byte so that it can
Implement again manually by replaying manually the recorded actions and fix mistakes
List the unresolved problems that make the implementation difficult or impossible and wait for those to be solved
When no problem remain, create a software appliance to generalize the implementation
Write an abstract specification
Create the software with the appliance(s)
Create packages for the software and launch their production with the packaging farm
Ask the operating system distributions to ship the result of the packaging farm

Heal

Become aware of a problem
Modify the tests and monitoring tools to get more information about the context in which the problem occurs
Grow bytes to trigger the problem
Create a fixture repeating the problem
Fix the problem and watch the tests and monitoring tools go back to green
Keep the fixture as part of the test and monitoring environment

Name and merge

The bytes are given a URL (i.e. a name) when in their primitive form : a reminder for an idea
When revealed to the public, the bytes are copied to other URLs and are therefore known under many names
The copies are altered independently
When a gardener becomes aware of a copy that was modified in an interesting way he can retrieve the changeset
The gardener can apply the changeset to the bytes located at a URL he controls

Implementation

Sat, 16 Jun 2007 18:08:00 GMT

Coding and system administration have so much in common that their development process share a lot. All steps outlined in Growing bytes are common to coding and system administration but their relative importance varies. For instance, continuous integration is an option when coding but is mandatory for system administration. In system administration continuous integration is known as system monitoring and uses tools such as nagios or munin.
Tests : whenever something is created (code or process) an associated test is run to ensure its existence
Web of trust : using scoring or crypto. When someone has read access he can write a copy and the copy will get merged withe the original branch according to a function of the web of trust.
Modifying is branching : the garden is on a mercurial file system.
Changesets : from changing a letter in a wiki to patching a driver, think of the modifications involved as a changeset that can be manipulated with tools like mercurial
Virtual currencies : every quantity that can be obtained from a service and checked for unicity is a currency http://svn.gna.org/viewcvs/pokersource/trunk/poker-network/pokerweb/pages/currency.php
Using software appliances to overcome the difficulties of multiple applications running in the same operating system http://garden.dachary.org/universe.html
Create a rss feed from URL changes http://specs.dachary.org/fam2rss/
Scrapbook iceweasel extension seems too slow and not maintained anymore.
For any given subject create a URL
The minimal URL is a URL that points to nothing and indicates an absence
Create a mean to convert a non existent URL into a text (bug report, tracker, wiki, tarbal, static text...)
Convert a text into a directory
- copy http://garden.dachary.org/empty.html
- cut/paste the text in the summary
- chose a URL
- change the site title + URL
Convert a text or directory into a software appliance
- DAV Tiddlywiki home page
- copy the text or directory to the home page
Convert a text to a text (i.e. move a text elsewhere)
- remove the text from the previous location
- redirect the URL to the new location

in /etc/apache2/sites-available/default
Redirect /gamenexus/scoredlinks-interaction.html http://www.tm-rating.org/wiki/scoredlinks-interaction.html

add the text to the new location

Convert a software appliance into a text (archival / compression) http://garden.dachary.org/universe.html#%5B%5Bdowngrade%20a%20software%20appliance%20to%20a%20directory%5D%5D
Visualy represent the proximity of two URL in time, based on the navigation history (bash, firefox): a flower with URL at the center, petals being previous/next URLs in time.

Unresolved Issues

Sun, 10 Jun 2007 15:04:00 GMT

On etch, when mount on DAV says that it will use fuser instead of coda the following fails : wget -O index.html http://tiddlywiki.com/empty.html, open file://.../index.html, import rsshijack from tiddlywiki.bidix.com and save.
There seem to be a limit to the number of coda fs mounted and when this limit is reached a davfs on etch uses fuser which seems to have other problems.
Tiddlywiki does not work with mozilla-1.7.5 http://www.tiddlywiki.org/ticket/341
Tiddlywiki interupt while saving over DAV corrupts http://www.tiddlywiki.org/ticket/342
What exactly is "large files" ? apache2-2.2.3/modules/dav/fs/repos.c

    /* ### this does not handle large files. but this is test code anyway */
    bkt = apr_bucket_file_create(fd, 0,
                                 (apr_size_t)resource->info->finfo.size,
                                 pool, output->c->bucket_alloc);
    APR_BRIGADE_INSERT_TAIL(bb, bkt);

RSS Feed integration in tiddlywiki

Sun, 10 Jun 2007 00:30:00 GMT

Get the plugin from http://tiddlylab.bidix.info/#RSSReaderPluginDescription with
http://tiddlylab.bidix.info/#ProxyService which is a proxy.php script overcoming the security limitations of javascript in a controled environment (i.e. the list of sites from which URL are proxied is limited).

This is no agregator and http://planetplanet.org/ can be used to agregate before integration in tiddlywiki.

RSS Feed generation in tiddlywiki

Sun, 10 Jun 2007 00:27:00 GMT

Load the http://tiddlylab.bidix.info/#GenerateRssByTag plugin to control which tiddlers are included in the RSS feed. Including all the tiddlers makes a lot of noise.

Tiddler Spec Template

Sun, 10 Jun 2007 00:19:00 GMT

Summary

What is being specified?

Links

The list of URLs that do not yet exist. A specification must be associated to at least one URL. When the specification is implemented, bytes can be accessed with these URL and they are removed from this list.

The liste URLs of interest to the specifications, including email addresses of participants or irc channels.

Rationale

Why is this being defined?

Use Cases

Describe the current user scenario.
Describe the desired user scenario.
List the steps (technical commands like ls ; cp ) to implement the desired scenario
Create tiddlers for complex use cases and tag them "Use Cases" so that they are listed automatically

Scope

Limits of this spec application.

Design

Design guidelines.

Implementation

Implementation steps and considerations.

Unresolved Issues

Discuss problems and unresolved issues.

Write the use case

Sun, 10 Jun 2007 00:06:00 GMT

The simplest use case is as described in http://garden.dachary.org/empty.html#%5B%5BUse%20Cases%5D%5D
The interaction path of a web site can mimic the page mockups at http://specs.dachary.org/gamenexus/scoredlinks-interaction.html
A complex use case can be described with statecharts

Image galleries in tiddlywiki

Sat, 09 Jun 2007 22:08:00 GMT

http://www.martinswiki.com/
import the following tiddlers

only the MediaWikiFormatterPlugin is necessary but was not tested standalone, yet. Seems to have problems with Image:foo.jpg

Scope

Fri, 08 Jun 2007 11:18:00 GMT

The use cases collection should cover an increasing diversity of people willing to garden bytes. From the passive visitors who merely leave a trace of his visit (or lack of such trace because (s)he wants to remain anonymous) to the developer modifying the behaviour of processes.

Garden does not implement tools, it describes how existing tools can be used for gardening and highlight the lack of usefull tools by explaining how they could help the gardener.

Upgrade to tiddlywiki-2.2 and DAV

Thu, 31 May 2007 22:06:00 GMT

Mount the DAV directory localy and copy the page to a regular directory to avoid DAV lossage
Save the old page

cp page.html page-2.1.html

Load the tiddlywiki-2.1 page into the web browser
Override with tiddlwiki-2.2

wget -O page.html http://tiddlywiki.com/beta/empty.html

Save the page loaded into the browser by using save changes. Beware, will not work with bidix upload plugin. Saving actually reads back the new page and inserts the content into it.
Reload the page to make sure it's properly upgraded.
Click backstage in the upper right corner
Import the webdavsavingplugin tiddler from http://tiddlylab.bidix.info/
Save
Edit and set chkHttpReadOnly: true to allow online editing by default