The Triumvirate

There are three things that matter in relation to a networked specific practice and media production. These three terms apply to the formal attributes of digital media, the qualities that practice requires, and how audiences participate, use, and engage with networked media. There is no hierarchy amongst these three terms, and they move prove to be insufficient. The terms are porousness, granularity, and facets. The list does not include database, user, or interactivity, as these are not causes but consequences of this triumvirate of terms.

Porousness describes the way in which the objects within networked media need to be open to each other internally, and externally. They are open internally to the extent that its constituent parts are available to its other constituent parts through what Weinberger has rather informally defined as ‘small pieces loosely joined”. Similarly, the work itself, as an assemblage of constituent parts, needs to be available to other systems and objects externally, out on the network. This allows them to be shared, curated, and used otherwise. Porous media does not want or need to monopolise my attention, screen, or hardware.

Granularity describes the smallest constitutive unit in a work that provides closure and coherence by itself. It is a meaningful whole, as is. This unit does not need to be narrative. A work that is highly granular can be regarded as very porous. When a thing is porous and granular they have a multitude of possible connections with each other. These possible connections are the facets that things present to each other, or which other things cause to be presented. As there are a multiplicity of such facets, in any networked practice only some of this set of facets are ‘realised’, however the more facets that are enabled and available, then the more possibilities for connections between parts exist.

Where the units within networked media are granular and porous then these elements remain as elements during, and after, publication and distribution. This means these small parts still make some sort of sense, even if shifted elsewhere and into other contexts. This makes it easy to remix material, and the facets that can be provided to search, find, connect, and identify these elements then the easier and more successfully things can be mediated and montaged.

Cinema has always existed in such a condition, and it is the shots granularity and porousness to other shots that makes the cinema possible. A shot, has, in the terms above, many facets available to other shots to form a sequence. This means that the shift heralded by networked practice and media may not be as large as many believe, so that it is not so much the formal attributes as others that need addressing as media making moves even more substantially into networked modes.

If I apply this to online documentary then it is easy to see that a lot of online documentary does not understand this. The most common criticism is that the works are closed, with perhaps a nod to the modern version of the guestbook (comments or some other crude device to collect and aggregate other people’s words to itself). The second is facets, where the ability porousness of the parts to itself are trivialised into menus of choice, even where such menus become fancy dots, mouse events, or some other way of making a menu appear to be anything but the menu that it is. This produces largely linear, radial pathways through material, much like the architecture of a 7-Eleven (put the key sellers, e.g. milk, at the back and have each aisle lead you through it, with the impulse purchases closest to the milk and the counter) which in so many ways betrays an anxiety of granularity, facets, and porousness.

Tags: , , ,

Matt Soar in Town

Matt is one of the drivers behind the Korsakow system, and has a long history of project based research across design, interactive media, and digital documentary. He’ll be in Melbourne for a bit, soon, and we’ve taking advantage of that to schedule a few events to pick his brains.

nonfictionLab presents

Matt Soar Creative Provocations ::: A seminar series presented by nonfictionLab

Matt Soar works across creative nonfiction in interactive video, as well as design. The Creative Provocations series hopes to generate productive discussion about the contestable and ambiguous nature of the concept of nonfiction as a point of intersection for extending disciplinary and interdisciplinary frameworks.

Workshop: Nonlinear Storytelling with the Korsakow System Saturday 29 June, 10am – 4pm RMIT city campus, Building 9, Level 2

The web is currently going through a period of rapid change in terms of innovations in nonlinear, interactive storytelling. The Korsakow System offers a powerful platform for reflective, observational, poetic storytelling using video, stills, audio, and text. This workshop begins with an overview of recent work made with Korsakow, the ideas behind the software, and a guided tour of the application’s main features. Participants will then have the opportunity to make a simple Korsakow film, beginning to make their stories using their own media assets. RSVP to adrian.miles@rmit.edu.au

Paperbag lunch with Matt Soar Wednesday 3 July, 12.30 – 1.30pm RMIT city campus, Building 9, Level 2, Room 6 (this is just for the RMIT peeps I’m afraid)

Matt will present recent nonfiction and experimental projects including a database diary film www.embres.ca and a non-narrative, experimental, remediation of found film footage using the Korsakow interactive video system as a ‘sketch’ tool: www.lostleaders.ca RSVP to ali dot barker at rmit.edu.au

Public Lecture come Presentation An Afternoon with Matt Soar Wednesday 3 July, 4.30 – 5.30pm RMIT Design Hub, Lecture Theatre Level 3

Matt Soar works across creative nonfiction in interactive video, as well as design. He is a project leader for the Canadian Adventures in Research Creation that focuses on practice and project based methodologies. Matt is responsible for the continuing development of a major interactive video authoring platform, Korsakow. In this seminar Matt will share his recent Korsakow database diary film C’est n’est pas Embres, and a non-narrative, experimental, remediation of found film footage, Lost Leaders. Matt’s research into ‘articulation’ and ‘assemblage’ in relation to Korsakow films and poetic online documentary will also be covered. RSVP to ali dot barker at rmit.edu.au

Tags: , , , ,

Nonlinear Storytelling Workshop with the Korsakow System

WHAT
Nonlinear Storytelling with the Korsakow System

WHO
Matt Soar (Concordia University, Montréal) and Adrian Miles

WHEN
Saturday June 29th, 10am to somewhere around about 4pm

WHERE
RMIT city campus, Building 9, Level 2.

WHY?
The Web is currently going through a period of rapid change in terms of innovations in nonlinear, interactive storytelling. This is partly because of faster computers and Internet connections, but also due to the emergence of a range of easy-to-use tools for media-making. The Korsakow System has been around since 2000, and offers a powerful platform for reflective, observational, poetic storytelling using video, stills, audio, and text.

This workshop begins with an overview of recent work made with Korsakow, the ideas behind the software, and a guided tour of the application’s main features. We will then make a simple Korsakow film. Participants will then spend the afternoon beginning to make their own stories using their own media assets.

How
Places are strictly limited. The workshop is free. To confirm a place (and please only ask for a place if you can attend) please rsvp to Adrian Miles

links

Tags: , , ,

Granular Deep Structure

Wherein I make the case that ‘database aesthetics’ in the context of online interactive nonfiction is a false excursus. I argue cinema has always been about the relational, and the database is an iteration of this same problem. As a consequence much online interactive nonfiction confuses navigation with narrative, and architecture with the cinematic.

A database is a list that holds information. This is not, technically, what computer scientists describe a database as, but we use a database when we have a list of things to sort and find in different ways, and then relate this list of things to another list of things (what is known as a relational database). The ‘things’ in a database can be text, image, in some cases video (though more commonly for online work it will be a text string that is the address of where the video is) and each refers to quite distinct types of entities. For example, a database might contain people’s names, URL as links to related material, and a text description. For media objects there is often formal data such as file size, screen dimension, file format, data rate, duration and media type. Records in a database, even where only text strings that provide addresses or pointers to other objects, are whole things from the point of view of the database, just like shots in a film. That is, the lists of things that we use databases to manage are precisely that, lists of things.

Therefore we can see that a database is not so very different to a trim bin, except to the extent to which the records in a database can refer to different sorts of things, (text, images, video, sounds, numbers, names, file sizes, and so on). However, structurally the problem of ‘database aesthetics’ remains the same sort of problem that has always confronted cinema, which is how to relate already meaningful parts together in a way to create something unified enough to be a new meaningful ‘whole’. That these parts in a database might be not all of the same media type (video or film sequences) would seem, on the surface, rather trivial, after all a historical documentary can use photographs, drawings, paintings, manuscripts, audio interviews, newspapers, paintings, poetry and video as original material.

Database aesthetics is then a problem of synchronic and diachronic combination, and the paradigm shift it performs is not the near to hand storage and retrieval of content, nor necessarily interactivity, but the way that the hard connections usually formed between parts are now soft and multiple. Historically and materially shots in films always had multiple possible connections and now this multiplicity can be realised each time I view the work where shots and sequences vary and where from any particular moment in the work some extent of the field of related possible things is made available via an interface or programmatically to the viewer.

As in the case of cinema and editing this is a problem of relation and is not a speculative new grammar, as a database contains already whole things, and as with cinema, these can be joined in most nearly anyway with denotation and connotation not risked. There is no grammar to be invented. The question and problem is much more simply about the type and extent of relations to be enabled where the database produces a relational rather than an interactive media which concretises the immanent multiplicity of relations already present between parts in film editing. In relational media this multiplicity remains after the event of publication. Such multiplicity is a problem of what is known as granularity and facetted relations.

This is a cinematic question, not a problem of database aesthetics or narrative. (To this extent database aesthetics is more accurately a post cinema practice rather than a breach and something new.) That this doesn’t often happen in online documentary merely shows the extent to which the field continues to confuse the navigational with the cinematic.

Tags: , , ,

Sometime Around 7am

dawn.jpg

Recording media, all recording media, as sampling machines. A camera takes a single sample, of a more or less contracted instant. A film camera takes 24 visual samples per second. An analog sound recorder makes a continuous sample of a microphone’s diaphragm, a digital sound recorder samples 44,100 times per second (that just does my head in), while with digital video we measure sampling usually, like the film camera, in terms of frame rate.

In all cases the technology of recording is indifferent to what it records. A camera, microphone, film stock, SD card, or lens doesn’t get more interested because something exciting is happening. The operator might, or indeed does and that is why the recording machine is turned on to sample in the first case. But the technology itself, the machine, just samples, usually strictly and regularly.

I am using this as a basis for a new small speculative project. Each morning, somewhere around 7am, I stand at the same point in my front yard and film the ridge over the way. I am using vine because while it records H.264 compliant video at 30 frames per second (so a specified sampling rate) it imposes a second order sampling constraint where each clip is limited to six seconds. I am, in this project, turning myself + Vine into a sampling machine where the sample happens at a specific time – 7am daily, and is geo constrained (if I’m not at home a sample will not be made).

The project, tentatively and imaginatively called “sometime around 7am”, is a digital video materialist poetics where I am become a sampling relay and instantiate the same sampling role as a media recording machine. The time frame is enlarged (six seconds every 24 hours or so), but that just shifts it from the mechanical, to the digital, to the human.

Tags: , ,

Documentary, Innovation, Futures

Documentary, like design, is a future orientated practice. It’s intent, even when dealing with ‘history’, is to effect change ahead of itself. As a result of this documentary as form (what it looks like) and practice (how it is made) has in general always been more innovative and experimental than fiction. I think for this reason, as film making catches up to what we can now do online, all the big changes are happening in documentary rather than fiction. For example there is the idoc project out of Britain, the Open Documentary Lab at MIT, and the IDFA Documentary Lab (Netherlands). Then there are the recent rise of new tools, including new versions of Korsakow in the offing, as well as popcorn, Klynt, Zeega, and W3Doc. So these are all new, but they definitely show that this field is about to take off, so something small scale and personal, such as Korsakow, is a good entrée to this stuff. This is also why we’ve worked predominantly in nonfiction. Nonfiction (documentary) is where this stuff is really gaining purchase.

Tags: , ,

Korsakow’s Palette (clouds, connectors and corridors).

As you work up, remake, bend, stretch, scratch, scrape, rework, manipulate, wend, tear, rip, cut, glue, paste, sketch, and otherwise think through the making in the doing of a Korsakow film it is worth thinking about what the terms of this making consist of. For example if I were filming something the terms of my making might include:

  • exposure
  • frame rate
  • composition and framing
  • movement (of camera, of subject, of lens via zooming)
  • exposure contrast
  • lighting
  • depth of field
  • focus

These are the formal things I can use to make with, my palette if you like.

In a Korsakow film, a part from the actual video clips (which would of course include the list above), when I am designing the work I have:

  • thumbnails
  • videos
  • sound
  • colour
  • background (colour, photos, sounds)
  • text
  • size
  • clouds
  • corridors

For each of these the other terms generally apply. For example for the thumbnails that are used for navigation I can think about if they have sound, text, colour. What size should they be? This is the formal language of stuff I have to work with, and their various combinations – keeping in mind I can have different interfaces in the one project.

In addition, via keywords, I have clouds, connectors, and corridors. Clouds are clusters of dense interconnection. Connectors are those nodes that bridge between two or more clouds. Corridors are passages that I want to insist upon, for instance (and most commonly) the opening screen of many a Korsakow project. Clouds I take from Mark Bernstein’s ‘cycles’ (in his “The Patterns of Hypertext”), connectors I think I just grabbed then since the alliteration was nice, corridors I remember from something Anja Rau wrote way back in the early days describing parts of Mark Amerkia’s Grammatron.

Tags: ,

Lists

Lists. An alternative to narrative.

poems, lyrics, dance, paintings, photographs collected under a theme, family albums, my record collection, our constrained tasks, the collection of someone’s vine clips, the Vietnam war memorial wall in Washington, William’s Changed the Locks, Eco’s The Infinity of Lists, A poetry of lists: heuristic approaches to complexity and ambivalence, latour litanizer, list of my favourite films.

Lists don’t have ends, they open up connections and possibilities. They celebrate that things are actually and always densely connected rather than pretending they aren’t. This is why they are common with monuments as to narrate is to categorise and separate and claim to be able to know that which can’t be known. So an ethics to the list.

Any my favourite, “things that make the heart beat faster” from The Pillow Book of Sei Shonagon:

Sparrows feeding their young. To pass a place where babies are playing. To sleep in a room where some fine incense has been burnt. To notice that one’s elegant Chinese mirror has become a little cloudy. To see a gentleman stop his carriage before one’s gate and instruct his attendants to announce his arrival. To wash one’s hair, make one’s toilet, and put on scented robes; even if not a soul sees one, these preparations still produce an inner pleasure.

It is night and once is expecting a visitor. Suddenly one is startled by the sound of rain-drops, which the wind blows against the shutters.

Which formed the basis for this experimental iBook.

Tags: , , ,