Monthly Archive for August, 2009

Bookmarks for August 27th through August 31st

These are my links for August 27th through August 31st:

No tags for this post.

Bookmarks for August 21st through August 24th

These are my links for August 21st through August 24th:

  • Afterimage: The journal of media arts and cultural criticism – Review of the 4th Video Vortex video conference series. Brief notes about what the presenters presented.
  • TheoraCookbook (en) – The Ogg Theora cookbook, as name says. Thorough.
  • BBC – BBC RAD labs blog: HTML 5 and timed media – Explanation via the BBC research group about their use and interest in HTML 5, video and using JavaScript to do interesting things with video that are time based.
  • video – A definition and discussion of the history of video. Very very good list of references included.
  • navigation – Glossary of media theory key words, student driven. Excellent definitions with very high quality references.
  • Assessment 2.0 – Conference slides about how assessment is very much old model and that with Web 2 paradigm and practices we can use this as basis for a different model of assessment.
No tags for this post.

Some Diptychs

I’ve made and published two diptych videos. For the previous nine or so years my practice has largely been one of constant formal experimentation, at a small scale, with interactive QuickTime online. The problem with this practice is that many of the works are almost unusable from a UI perspective, but also that while I thought I was trying to explore and build a vocabulary because there is so much variation amongst the works the end result is closer to noise than a language. It is a body of work that is very formal and the only significant content is in terms of the formalist propositions each of them make. Most required mouse enters to do things (the mouse had to enter a particular part of the movie). This might have been a button, though in many cases it was the entire video. Once done this might speed up, slow down, mute, or make other tracks visible or invisible. It might even make text appear and scroll.

So, the diptychs. Simple two video pane structure. You can speed up or slow down each video. You can also pause them. There is a separate soundtrack which you an also pause. Some of the videos will probably also have a link or links in them. These will be images that are clickable. This uses a child movie structure where each of the video panes is a separate QuickTime movie being played within a containing QuickTime movie (sort of Chinese Boxes arrangement). This is how I can play one and pause the other, and vary their speeds.

Why? Well, after nine or so years of doing this, and having taught cinema studies for a few years before this, and being deeply influenced by Deleuze’s two books on cinema Cinema One and Cinema Two I remain fascinated, intrigued and wondering about duration, movement and the cinema. While film and video offers a single sequence of a fixed speed (yes we can have fast and slow motion but playback is fixed, resolutely and imperially) so that relations become between this then this, with online video, well, with softvideo, duration and movement are ripe for rethinking.

For example how long is a diptych movie? What does that question now mean? Imagine each of the videos runs for one minute. Is the length one minute (how long it would run if you did nothing?). Is it two minutes (since it might be thought of as two different movies each of one minute which happen to be viewed next to each other)? But since they invite you to play and pause them independently of each other, and since they loop, it is possible to suggest that the video itself, what you or I watch, if played with (ie if the speed is manipulated by you) has no determined duration. If we think that the work itself is not just each individual video, but also the possible relations between each of the two videos (what this one shows in relation to what that one shows) and either can be slowed or accelerated then there would seem to be a variable set of possible relations between the two shots. So if the film is this, then it just doesn’t make sense to wonder how long it is.

Then, of course, there’s the whole set of questions that are a consequence of letting the viewer be a user and do things that affect, in whatever way, the work itself. At the moment, for me, this is not so much about making interactive or multilinear video narratives or poems (I think poetry, or for that matter lyrics, are a better model of what to do than traditional narrative, whether filmic or not) so much as just rewondering what video is now. Prior to this video and film were linear, sequential and fixed. This is in their very deep nature, it is what makes editing even possible. But is it still video in this new regime? Or something else?

So, I’ve made the diptychs so that I can just stick to a structure for a bit and make work for it. Work that might contrast betwen the two windows, works that might reflect each other, and so on. I’ll make up a mock one shortly and publish it so that others can use it too, if they like.

Tags: deleuze, practice, softvideo, Vogging

Bookmarks for July 29th through August 18th

These are my links for July 29th through August 18th:

No tags for this post.

Workflow

Right, so I’ve got a new WordPress blog installed, paid for a theme, which even though it can’t actually play QuickTime natively does a good job of presenting stuff for a video blog. So to do videoblogging this is my current workflow, and writing this out I’m surprised, and perhaps saddened, that it has not changed since I started in 2000.

Now, after shooting, capturing, editing and building I often do some scripting, but let’s think of this post as just about publishing the video (which is an interesting phrase in itself, isn’t it?).

  1. Open the finished video
  2. Get a screen grab for the poster (using Snapz Pro)
  3. Edit this screen grab down to size in Photoshop for a poster movie
  4. Edit this screen grab down to size for an illustrative thumbnail image used the blog template
  5. Put this screen grab into LiveStage Pro so that I can make a clickable poster movie
  6. Upload the finished video via FTP to my server
  7. Upload the poster movie via FTP to my server
  8. Log in to my blog
  9. Create new entry, title, tags, categories, text, etc
  10. Select thumbnail graphic and upload
  11. Launch pageot
  12. Enter details of the poster movie (url, dimensions, controller and autostart off)
  13. Copy and paste code into embed field of the blog template
  14. Publish

Why don’t I just use a video service such as blip? The actual videos I make cause problems since they rely on interactivity which is part of QuickTime, so if they get transcoded they just break. I can of course keep the original format at Blip, and use that, but most of my recent work uses child movies, so an individual work (for example the diptychs I’m currently working on) actually consists of 4 separate QuickTime files with scripted relations between them. This means they all have to live in the right place to work. (I could upload them to Blip and write the links to the urls out of Blip, which is an interesting experiment which I think I’ll do just for its own sake.)

I have also made interactive poster movies before (which when clicked on load the actual movie), uploaded these to blip, and embedded these to the blog. The only advantage of doing this is that adding to the blog is really easy, but all the other steps are still needed so it actually just felt a bit harder to do. Perhaps I’ll do this again and compare. This would cut out getting embed source code in Pageot (though it does need uploading to blip, setting a pile of options, and then getting code – though I guess if i just auto published to the blog from Blip that would make things pretty simple).

But I digress. The point is why has this not changed in 9 years? Yes I can upload to Blip and every easily publish to my blog and it generates what is pretty much a clickable poster movie for me, but what happens if video is not a single object? Like a blog (which for example is made up of lots of individually addressed and addressable things called posts)? Why can’t I take advantage of basic QuickTime embed functionality, for example define a template at Blip (size, controller off, target is QuickTime Player, href attribute for the mouse click?

Why do I need these? Because I have diptychs that are 1280 pixels wide. I guess the answer is pretty simple, services are just that, and these are experiments. And on that note it is back to the lab!

Tags: Vogging

Backend Work

So, been busy building a template to use as a basis for quite a few works. I’ll talk about why another time. But also wanting to start a blog that just has the video, nothing else. So been looking at the templates at press75.com where there are some video specific ones. What appealed are some of the gallery view options in some of the templates – just like the idea of that wall of images with video behind them – and the thumbnail and video plugins they have. Unfortunately they aren’t quite what I need, which is probably symptomatic of how I approach this video caper.

First of all the gallery stuff, I’m about to play around with it but I often make work that have odd shapes. For example the diptych that I’m using is over 1600 pixels wide but only 360 pixels high (it places two 16:9 videos alongside each other). But the galleries all seem to be assuming either a 4:3 or possibly 16:9 aspect ratio so how the heck will it cope with long skinny, or narrow wide thumbnails? Of course in the interests of neatness I might just have to crop and cut and hack the images into the default gallery size so the template works…

Secondly it seems the video plugin is a simple FLV player. Well, simple because all you need to do is a) upload your thumbnail (or point to its URL), and b) put in URL of the video (from a variety of service or self hosted) with width and height. Hey presto. Except since ti relies on FLV it means interactive QuickTime doesn’t work since interactive QuickTime requires QuickTime as its runtime engine. So what I thought would be a neat system actually doesn’t work at all. So, I’ll experiment a bit more, but right now I think the easiest way to embed video in WordPress is to use Pageot to write the embed/object code and stick that in your blog post.

Why you ask? (Well, I know most of you don’t but humour me.) Because then I can have a poster movie which when clicked loads the actual movie and can target a new window, QuickTime Player or the current window. Being able to target QuickTime Player through the embed code, without having to write an interactive movie, is good because when you make a movie that is 1600 pixels wide it tends to break in a lot of browsers so just making QuickTime Player actually display it means it will display properly. Also means it tends to run better since you’re using a dedicated app to view the work rather than the plugin.

So, back to the experimenting.

Tags: Vogging

Recent Developments in the Diptych Department

Well, the riveting coding work continues. So I think it is time to pop out a work in progress so that things make more sense. The diptych here is not how things will be in the final work. I do want to speed up and slow down the video, but what I was doing was constraining this so that after, say, slowing or speeding it up by a factor of 5 (so 5 x faster or 1/5 of normal) I’d flip the track back to normal playback speed. After building it and experimenting and playing with it it just doesn’t make sense. As you’re clicking the thing slows, then all of a sudden after another click, Hey Presto!” we’re back to normal speed. Nah. So this work in progress is just to see this in action. What hasn’t been done yet, well, both soundtracks remain, these will be removed and one soundtrack will be added as a separate child movie so that it plays normally independent of the image track speeds. This means the effect you get when mousing into either video so that the volume for that track changes will be removed (though in this demo it does create some pretty weird aleatory outcomes). So that also means I’d better let you mute, or perhaps pause?, the soundtrack.

Next Iteration?
For the final version clicking the slow and fast buttons (‘-’ and ‘+’) will just keep speeding up or slowing down the video. QuickTime from memory doesn’t like to drop below 1/10 of normal speed (normal is whatever the video frame rate is) while I think acceleration probably depends on your CPU. Mousing into the other button (eg if you’ve sped the thing up, then mousing into the ‘-’ button) will restore the current video to normal speed. Then add a pause button for the soundtrack, and perhaps see about making the buttons semi-transparent so they’re not quite so there. That should do it. I think.

Tags: Lifes Little Pieces, vog, Vogging

Coding Development

Well, been scripting, sketching and testing. The pathway to date has been:

  1. make a diptych
  2. mouse into either video increases volume of audio for that track
  3. you should be able to pause either video
  4. mouse out returns video to original (approx 10%) volume
  5. include time based links in each of the videos

Then it also became

  1. let either of the videos (in either pane) able to be accelerated or slowed

This has raised all sorts of interaction questions and issues. For example, mousing into either video to change soundtrack is not intuitive, and depending on the video it may not be clear that mousing actually does anything. Now I prefer mouse over and mouse enter to mouse click for making things happen. It makes the videos more like touch movies, things you have to caress, rather than these bloody clicky things. However, in adding the buttons to speed up and slow down the movies it seemed that a mouse click made more sense since I can imagine people just not getting what goes on when things happen just because you mouse into something. Of course changing content or style as a direct response to the mouse in helps (like the way you can make links change when you mouse over them in HTML using hover in your CSS), but that is different to actually having the work do something qualitative (eg change speed) because you mouse into something. The bigger issue that this then produces is inconsistency – you mouse into the video to effect a volume change, but you have to click other things to make other things happen. This is not good.

Then to compound it once you start speeding up or slowing down the video then mousing to change the volume becomes irrelevant. Once the video is going faster you just get very fast sound, and conversely when it is going slow you don’t get much at all – who cares and what does it matter if you can, or can’t hear it?

So right now I think I will remove the sound change sprites. I will also remove the soundtrack from the video and actually run that as a separate, third childmovie. What this means is that the sound will play, at normal speed and volume, regardless of the playback speed of the video windows. I haven’t implemented this yet, but particularly like it (well, until I test it). This way you can slow down, accelerate, stop the videos but the sound track (and possibly commentary?) will continue. Of course I then might need to stick a mute button on there too. mmm.

As usual with me the scripting is slow. I’m not what you’d call a programmer. I got the faster and slower buttons working fine, basically it counts mouse clicks and the faster does an argument where the film speed is set to multiply by the number of clicks, up to a maximum of 5. Therefore it plays at normal, twice, triple and so on up to five times normal speed. The slower button I divide normal speed (what QuickTime thinks of as a rate of ‘1′) by the number of clicks: so 1/1, 1/2, 1/3, 1/4 and 1/5 and after 5 the variable (mouse clicks) is returned to 1. This though causes problems, since you can speed the film to 5 times normal, then 2 clicks in the slow and the movie is now 1/2 normal speed, not 1/2 of what it was before. eg If I click 4 times the video (lets assume it is 24 fps) will not be running at 96 fps, so clicking on the slow button you’d think should say, half the current speed.

The problem with all of that is that if I’ve made the video faster and it seems that this button should make it slower, then that’s what it should do. So, the first attempt at this I counted mouse clicks and saved them to a variable and used this in both sprites. Quickly figured out that was pretty stupid, clicking the faster one 4 times to get a video 4 x normal speed would mean clicking once on the slow button the video is not 1/5 of normal speed. That just seemed rather a large change. So I spent a lot of time trying to work out ways to do all of this, and the solution I’ve finally got to is not ideal, but is a bit clearer from a user experience pov. Basically for each sprite I now check for current film speed. For the go faster sprite if the film speed is less than ‘1′ then it has been slowed down, so I then make the film speed 1 then start counting mouse clicks to accelerate it. This means if you’ve got the video at 1/5 normal speed and you go to click the go faster button then it restores playback speed to normal, then starts going faster.

Similarly for the go slow sprite it checks to see if the film speed is more than ‘1′. If it is then the user has been clicking the go faster sprite and so again if you click the go slow button the first thing it does is restore the film speed to normal and then start counting mouse clicks to slow the video down. I tried to work out a more elegant solution, for example simply multiplying current speed by mouse click to accelerate the video, but the maths doesn’t work. For example if the video is playing at 1/4 normal speed and you then click the go faster sprite, then I need the video to now be 1/2 normal speed, the calculation to get that would be 1/4 x 2, and I could get the mouse count to 2 for this, but then click go faster again and the calculation becomes 1/2 x 3 so instead of getting to normal playback it is 1 1/2 times. This might not matter that much (though once you start playing with the work you’d never get normal speed again), but then when you start slowing it down (and so dividing it by the mouse count) you just get all sorts of variations – 1.5 normal speed divided by 1, then 2, then 3…

Ah, but you see I’m such a poor programmer that in writing this out I see that I’m doing this all wrong! All I need to do is to divide or multiply speed by a constant (say 2) and just make sure it doesn’t work past, say 5 iterations (5 times acceleration) and things would work. Sheesh, I really struggle with this stuff because now I can see just how bleedin’ simple and obvious that is. OK, let’s return to the kitchen and try that one out.

UPDATE FROM THE KITCHEN
Bugger. The two actions available are SetRateTo(x) and SetRateBy(x). The first is an integer that just sets the playback rate (1 for normal, 2 for double, etc). The second you’d think might be a multiplier, eg if you entered 2 then it would double, but the ‘By’ in SetRateBy just adds, so if you put in 2 then it just adds 2 to the current playback speed. If it were at 1, then you’d get 3, 5, 7 etc. This makes it good for the go faster sprite (SetRateBy(1)), but for the go slower sprite there aren’t any numbers I can add to 1 to end up with less than 1! Also if the number becomes negative the video plays backwards, which is not the effect I’m after.

Tags: Lifes Little Pieces, Vogging

Link Movies

I’m working on some new videos. The videos themselves are simple and straight forward, but the architecture for them is taking some trial and error, or what in academic talk I’d describe as ‘iterative development’. The basic structure is a diptych, with most likely the same video in each video pane. They will play alongside each other, as child movies (think Chinese boxes, complete movies inside other movies) so they can have independent play states. One will be pretty hi-rez, the other lo-rez. I’ll talk about why another time. At the moment they have their audio set quite low, and when you mouse into either video pane the audio for that panel goes to full volume, but I also want links in the video. These are links to external sites. The issue is that these links will be time based and so appear, then disappear. So, when you mouse in to such a link what should happen? And when you click what should happen?

link

The first experiments I did I just had the sprite (the image you mouse into) change the mouse to a pointing hand and changed the image to indicate that it was a button come link. That was OK, but it does not tell you anything about what the link come button does. So the next iteration I replaced this with a 50 x 50 image of the destination, for example a screen grab of the web site that the link is to. It is too small to tell you where you’re going, but it is recognisable a web page so you should be able to work out pretty quickly that it will take you to a web page.

But when you click should the movie stop, or continue? It sort of makes sense to stop, since you’re being taken somewhere else and once you’ve gone there you can always return (if interested) and continue where you left off (the click creates a play/pause effect, click once you stop and load url, click again and it resumes playing). But remember there are two videos playing alongside each other so the click should then probably pause both videos. Alternatively I could provide simple controllers for each video which lets you play and pause each video pane and so you could then stop the video, and follow the link, and then it would make more sense to just let the link be a link without pausing the video (it is not a good idea to make that stop and link when you already provide a sprite that play and pauses the video). The problem with this one is that now things are getting pretty busy. I can play the video. Stop it. Times each video pane. And I can click on a link which loads a URL and if the video is not stopped it will keep playing, or if the video is stopped then it stays stopped.

diptych

I like the idea of the link stopping the video, but then you’ve got no way to stop the videos if that’s what you want to do, which is generally a pain in the arse. The other issue is that since the links are time based, i.e., they disappear, do you need to be able to scrub or return to follow the link because you didn’t earlier, or there was more than one to follow? I think what I should do is:

  • let the videos be slowed down and accelerated
  • links should not pause either videos
  • clicking the link again should resume
  • a simple play/pause button should be provided (that stops both or one for each?)

That way you can slow them down if you like, so playing with their speed in relation to each other. You can follow the links, and you’ll quickly learn they don’t stop so if you want to stop then stop then click the link, and we’ll see how that goes. Oh, and I think I’ll install a new WordPress blog which will just host the video content (perhaps using one of these templates), stuff is just so lost in here and it is perhaps time to just have a single place to collect the video work.

Tags: Vogging

Vogging

Have started sharpening the mouse for my coding skills in LiveStage Pro (which still runs happily, after several system updates, moving to another computer – all in spite of the company now apparently bust). I’m making diptychs where mousing in changes the sound level, and I’m also playing with adding links in the videos. At the moment the links are URLs out to pages around the place, but I am thinking through making the links also go to other video works. The problem with this is that I neither need to treat these videos as an individual project, since earlier videos aren’t going to have links, or just use tags and links in the text of the accompanying blog post to do this.

This is one of the issues with serialised authoring, as while you can (if you can be bothered) link to earlier content you don’t generally make a habit of going to earlier posts and linking to more recent ones. Hence the internal link structures in your own blog (or other serialised form) tend to be only backwards looking. One solution to this is the development of ‘related’ or ‘more like this’ plugins in blogs so that stuff out of the archive can be joined, backwards and forwards, through your material. To date I don’t think there’s a very good solution for video in this context. Related links sort of work, and I imagine a series of gallery pages (think rows of thumbnails) that are the result of tag searches would also be useful for this.

Systems like Korsakow for video (and Tinderbox for text) solve this since they are database structures where you add new material and then there are rules you have written which define how things link to or relate to each other and how they are to be presented. The advantage of this sort of system is that relations are just that, and so can join old to new and new to old.

Tags: Network Literacy, Vogging