Archive for the ‘softvideo’ Category


I’m currently attending UWE’s two yearly i-docs conference at the beginning of March. The conference is run by the i-doc research group in Bristol. I will be presenting recent research that interrogates (criticises, questions, even possibly politely attacks) the hegemony of story in interactive documentary. The world isn’t a story, why should nonfiction works about the world be obliged (feel obliged) to always be a story?


After scrambling and cobbling together dollars from a variety of sources it looks like I can get to this year’s i-docs symposium, hosted by the i-Docs mob from UWE. My first. I’m excited to see Bristol, to catch up with some friends, and to see what is going on.

I, in that way that is easy to do when you don’t know the people involved, think that a lot of the work being done in interactive documentary (and a lot of things that are called interactive documentary) is not doing very much. This is partly because many moving into this area come from heritage industrial practices that mean that when we meet the novel, different, and strange, the first step is to translate this into current terms to understand it. It can be a similar story theoretically, where this is often a tacit reappropriation or incorporation of the differences of interactive documentary back into existing paradigms of film and documentary theory. Hence, as a simple example, the hegemony of story to nearly every single theorist and practitioner in this field.

So, following up on my recent post on multi and non linearity, and to , well, I was going to say ‘be intellectual provocateur’ but that sounds way too strategic for me. (I get a little autistic around ideas. What that means is all I ‘see’ are the ideas, not the people attached to them. A bad idea I treat as a thing that is unpleasant and unwelcome, and I can be blunt and direct. I once thought it was because I didn’t grow up middle class and so never learnt what I think of as the protocols of sobriety – where I grew up if something was silly, wrong, stupid, ignorant, or dumb, it was called that, we didn’t really have euphemisms and conversation veered towards agon. But I’ve realised it’s more that I just see ideas as things, objects in their own right sitting there, in an intellectual ecosystem (like the red box eucalypt outside my window) and I discuss its qualities as this thing quite forgetting that they have people attached.) So, as someone who sometimes just has to call a spade a spade, this illustration (I’ve borrowed the URL from the i-docs site where it is captioned as “Interactive Documentary Structure from i-Docs 2012”) below needs something said about it.

In my conception of multilinearity and interactivity this drawing is neither, and I think it is illustrative of the poor understanding about interactivity and multilinearity that bedevils thinking in this domain. What are its problems?

If I were a user in this work then my its structure would appear to me as a branching tree (aka choose your own adventure) where my choices have no consequence or implications for the shape of the work (it is fixed). Hence the only way I could learn that it is indeed multilinear would be to get to the end, start again, go to the same two first places, and then (if I can remember) choose something different to go somewhere else. Hopefully the interface provides enough information so that on this second (and third, fourth, etc) reading/viewing I am able to make a decision to not end up in the same place on the fourth ‘level’ of the work.

What else? The illustration is in thrall of an inevitable, determined, definite/definitive beginning and ending. How we ‘do’ things in this domain, temporally (as it is a temporal, not a spatial problem here as we’re talking about hypertextual montage) is all about offering some choices to the user (in an act of generosity as makers we surrender absolute control) but only as long as you begin at the beginning and end at the ending. These remain singular and simple.

This model is indebted, ideologically and intellectually, to the epistemology of print literacy and culture as all those arrows, resolutely moving us to the right, live in fear of recursiveness, repetition, and rhythm. It is only print that insists on linear seriality with no repetition. Painting, dance, song, oral cultures, poetry all rely upon and celebrate repetition. For example who doesn’t revel in those moments in song where a chorus returns the second, third, fourth time, the same but of course oh so different now. Or the repetition of some signature short phrase in a song that, through this very repetition and redundancy shifts the duty of the song and its art from narrative and description and telling into incantation and doing as the words become musical, material, concrete, affective, carnal, embodied, ephemeral, solid.

Recursiveness is not redundancy and lets a work have rhythm. Recursiveness is not redundancy and lets users see that, as they return to where they have been, that they can do and go otherwise and that their actions come to matter for the very shape of the work. If, as happens in this drawing, I choose and arrive, choose and arrive, choose, and it ends, how, apart from beginning all over again, like Sisyphus, would I ever have the opportunity to know I have agency? Which of course is much the same as saying such structures think they confer agency, but do not.


Multilinearity, Notes on Terms

Franzsi interviewed me last week and had some provocative questions, observations, and concerns. It was good to be called to account and to stretch ideas. One of these proddings was around non versus multi linearity. I prefer multilinearity as a way to describe the sorts of interconnected nodal things I make and advocate. Others use ‘nonlinear’. Franzsi wanted to know, more or less, why multilinear rather than nonlinear and what’s the difference?

Answers, as far as I can tell, are a multiplicity, not the one nor the many.

An answer is that hypertext (unlike interactive documentary) has already rehearsed these terms. Nonlinear and multilinear were both appearing at the beginning of hypertext theory, almost as synonyms. Each was used to make apparent how hypertext and its pathways between small, distinct parts was paradigmatically different to print text. Let’s call this the first wave of hypertext theory which spent a lot of its intellectual energy arguing for how hypertext was not print. Second wave hypertext was the inevitable Oepidal response to more finely tune (as Pickering might say) by arguing that the changes wrought by hypertext might not be as dramatic as the first advocates claimed. Second wave hypertext argued that while there might be different pathways through a work these, though variable, still formed linear syntagmatic chains, and that syntagmatic chains, where this and then this happened, could not be avoided. So the argument was that this was not really nonlinear, was it? Third wave hypertext theory moved this along by accommodating this and recognising that yes, in hypertext, sequences form, and what matters is not the presence or absence of sequences but how they come to be formed, and how they vary in themselves.

An answer is that in chemistry and many other fields nonlinear has quite a specific, and interesting, definition. (Now I’m a humanities academic who, at best, is going to provide a bastardised account of this, so think of this as a loose meta view and cut some slack.) Here, or there, I understand a nonlinear system to be a system where incremental addition/change creates a linear (regular) change in the system, until a threshold is crossed and the system ‘flips’ from linear change to nonlinear disorder. So there is no simple proportional relationship between the variables in the system. Order might happen after, but it is a very different order to what was before.

Another answer might be that nonlinear has connotations of randomness, yet in the domain of interactive media our practice is to choreograph a dance between generative procedures, structures (patterns), and the stochastic. How this dance is choreographed is what matters, and even varies in individual works, but is hardly only ever random.

An example of a nonlinear system is pollution entering a lake. Imagine the same amount of whatever this polluting substance might be entering each day. This is a linear amount. One litre each day, so after 2 days there has been 2 litres added, 7 days 7 litres, and so on. The effect on the lake, to begin with, will also be linear. n litres will mean, let’s say, this sort of impact on the ecosystem, n x 2 litres will double the impact. However, at some point (and the trouble with nonlinear systems is we don’t really know where this threshold actually is, which is the real issue with global warming), adding that same amount for one more day sees the ecosystem collapse. The whole system flips and, for example, might have moved from being aerobic to anaerobic, so nearly everything dies.

Another example of a nonlinear system is common in medicine. A drug we might take does very little if the dose is too small, and a lot if the dose is right. If this were simply linear then taking more of the drug would improve its efficacy. Yet with many, if not all, drugs, there is a threshold where they no longer benefit but in fact cause harm, in some cases, catastrophic harm.

This is what nonlinear is.

In relation to interactive media (for example a Korsakow film) that understand these affordances this thicker notion of nonlinearity is, I suspect, an interesting and provocative way to theorise what happens with readers. I click, click, click, wondering what is happening and why, and then, ah, I begin to understand. That ‘ah’ is the phase transition, a threshold, where I move from random clicking to the discovery of what I take to be a significant pattern. This emergence of a pattern, performed by the reader, is a different question or problem to that asked by the general structure of interactive work. For this general structure is not usually nonlinear in this sense, and I don’t see that very much is achieved when we use complex terms poorly in our own field.

Cutting Floor Two

The notion of the affect image as slow interval, as the indeterminate that falls between noticing and action, offers a radical critique of interactive documentary poetics, and a compelling alternative methodology. It lets us see that interactive documentary may be less about ‘access’ (social engagement and reach, sociocultural critique), or even novel technocultural forms (it is about all of these things, but this has always been documentary’s charter) but about interrupting, suspending, and slowing the ideas, events, and problems they address. This is largely not the case in contemporary interactive documentary where much of the work being discussed and identified as interactive documentary is caught in a first wave of a digital delirium where the ability to combine, link, and then present media in multilinear and nonsequential ways becomes a parade and celebration of technical spectacle. (It is a reprise of Gunning’s ‘cinema of attractions’ applied to new media.)

In the current context of work that is available and being discussed theoretically, interactivity is diluted and under theorised to the extent where recent academic work can provide a definition of interactive documentary that, at base, says little more than that interactive documentary is documentary that is interactive – leaving the key term mute.

The celebration of technical spectacle is perhaps more complicated, as the rapid rise of new protocols including HTML5 and CSS3 combined with the development of JavaScript libraries such as popcorn.js and video.js, and Application Programming Interfaces (APIs) to existing and new platforms, sees a slew of experimental work being undertaken. The best of this work offers, provokes, and asks questions of form, narrative, style and documentary, yet many seem to confuse technical adroitness and a digital spectacle that bewitches and beguiles — I suspect because many critical theorists have little experience of code and digital building.

In a nutshell much interactive work confuses a literal and direct action with interactivity, or becomes explicitly or implicitly concerned with the technical language of coding as special effect (for instance witness the excitement and rapid adoption of the curtain.js library as a sort of cinematic web special effect for long form web nonfiction).

Expanded Doco Symposium Coming Up

Being Observed

Franziska Weidle is a PhD candidate in anthropology from Göttingen who is doing field work on Korsakow. We, it turns out, are the field. She’s a great addition to the non/fictionLab and documentary group, participating in seminars, workshops, supervision and so on. She’s started a blog for her field work on Korsakow.

Storys and Parasites

The beginning of my Visible Evidence talk. Perhaps too much back story, but a bit of colour might go a long way to hiding the cracks. (And now that Mark is working on Storyspace, I’m rather keen to return to it.)

At a conference in Melbourne in 1991 I had an epiphany. I was in the then new medical lecture theatre having trooped across a busy highway from the usual conference venue because it was the doctors who had a data projector, and, a computer. The speaker, from a liberal arts college in upstate New York, showed Storyspace, a hypertext authoring and reading program. This was two years before Mosaic, the first graphical web browser, and coincided with the first version of HTML, the mark up language that the web relies on. Storyspace allowed writing in an associative, multilinear way. You could link from word, phrase, sentence, node, to word, phrase, sentence, or node. A word or phrase, anything really, unlike what happened with HTML, could have multiple links, so if something was related to three ideas you simply made three links from the same phrase.

The epiphany? This mirrors how I think, the way ideas and things are always densely intertwingled, entangled, implicated promiscuously by each other. I have always struggled, with invisible horrible difficulty, with writing, and its tidy introductions, polite serial this then that capped by a well crafted conclusion that teleologically appears inevitable, collecting the previous pieces into a white picket fenced whole (snipping off the bits, discretely, that might hang over).

Links in hypertext are not navigational. They express affinity, agreement, elaboration, disagreement, confusion, relation, relevance, contrariness, and connection. Writing here is a live laboratory of thinking in practice because the links made in the act of writing establish the relations that create structure and this structure emerges in the very act of writing. Links create an epistemological structure that does not precede their writing, and the shape of what is formed, the network of relations that emerges, is never known in advance. This by the way is a Latourian actor–network.

From this I learned that links create multiple relations between parts, that writing done this way could still make knowledge claims, and that links emerged iteratively and generatively in the act of writing. I also learned that for this to happen I had to surrender some of my agency and to trust in this surrendering. I learned that ideas are things that are obstinate, and this is their pleasure and right for they have their own agency, quite apart from me, and that as things they have different ways, different facets, through which they can be interconnected.

This is why I am sympathetic to and an advocate for programs like Korsakow. Storyspace relies on links, and Korsakow keywords, and both require you to work inside of their procedural milieu’s where control over form and relation and pattern, the sort of control that writers and filmmakers have traditionally exercised with fascist finesse, must be surrendered. In other words, you learn how to listen to things, whether they be words, ideas, videos, or bits of the world.

For me this describes, fundamentally, a nonfiction practice if for no other reason than the elements being worked with retain autonomy and agency, a discreteness, that gives them a recalcitrant thinghood. It is this agency of things in the world world, quite apart from my intent, that I want to argue for in relation to interactive documentary. The generative, procedural possibilities that interactive documentary offers have affinities to the world that make it distinct from those that story and narrative and representation offers. It is not that we should not use stories in interactive documentary, but that we are colonisers of interactive documentary via story. I am not sure I know how to say this simply or clearly, however, if the world is made of things with agency in their own right, and, if particular ways of making procedural, generative multilinear works also allow things to retain their agency, then we have a possible nonfiction practice and form that adopts, at least to some extent, the points of view of the world. [Note the divergence from orthodoxy here, agency is not the work or the user but things.]

For today’s talk I will take this dense multilinearity, the way that parts are allowed to find and form multiple relations amongst themselves, as a key affordance of interactive documentary. [Note that interactivity is here a consequence of multilinearity, not the other way around.] Such multilinearity is not teleological, emerges through its doing, and allows its parts to have more agency and autonomy than stories generally allow.

[And the point of the anecdote? That hypertext is made up of self contained notes that are put into relation with each other. Just like cinema. So hypertext, is a post–cinematic writing and interactive documentary, as multilinear systems negotiating self contained parts are also varieties of post–cinematic writing.]

Interactive Doco at VE in Toronto

This is my list of the panels that seem to have something about interactive documentary/new media at Visible Evidence in a couple of weeks, gleaned from the current schedule. Let me know if I’ve missed someone. It’s attached as a pdf, embedded here as a graphic, because I’m not going to write a pile of HTML table tags….

PDF of Interactive Doco Stuff

Matters of Concern and Interactive Documentary

Matters of Concern and Interactive Documenary is a working paper of mine that is the beginnings of a project to think about new materialism in the context of interactive documentary. It is coming from a desire to ‘think’ the materiality of interactive/multilinear practices/things, as well as what might become a poetics of engaging with the world (nonfiction/doco) that is not story or narrative based. (Stories seem to be an enormous correlationist conceit on our behalf…)

By the way, ‘matters of concern’ is from Latour.