The main new feature is Syphon support on Mac. For the rest, we’ve greatly improved the overall stability of the application and crushed a few bugs that made it to the 1.5 release (Read more for details and download links).

About Syphon

Syphon is an open source Mac OS X technology that allows applications to share frames – full frame rate video or stills – with one another in realtime. Until now, Syphon could already be used in GrandVJ through Quartz Composer, the graphical modular language of Apple.

Syphon is now natively supported by GrandVJ, where it acts as an additional (virtual) output. Through Syphon, you can send the output from GrandVJ to any other application that support Syphon as input, which makes it possible to use GrandVJ as video mixer module in some more complex setups!

As usual, we tried to make it as easy as possible: the Syphon output is automatically activated when a Syphon client is running, there is nothing to configure in GrandVJ.

If you want to use Syphon as input, you can still use Quartz Composer, please refer to the official Syphon website for more information.

Stability improvement

Less fun, but not less important, is the stability improvement of the application on both Mac OS and Windows. We’ve notably fixed problems related to some particular video file formats and issues occurring when activating full screen.

This version is another free upgrade for all GrandVJ users, we hope you will enjoy the new possibilities offered by Syphon!

Download

You can download GrandVJ 1.6 from the download page on our web site.

Changelogs (1.5 → 1.6 beta 1):

• added Syphon output [Mac]
• added the ability to browse using arrow keys
• fixed a potential crash when loading files that are played by QuickTime
• fixed a audio/video synchronisation problem in FFMpeg player
• fixed a problem when using a third party audio device [Mac]
• fixed PCM audio playbackfixed a crash when triggering effects
• fixed a crash when switching fullscreen off
• fixed a crash when previewing a transition
• fixed bank rename save

This Release Candidate version should be the last one before the official release. It includes all the features, graphics and documentation of the official version. All the bugs found in the beta have been fixed, we have also resolved some instability issues that were affecting previous versions of GrandVJ.

ArKaos GrandVJ and Ableton Live:

http://www.youtube.com/watch?v=XR2YVjoycxU

ArKaos GrandVJ and Steinberg Cubase:

http://www.youtube.com/watch?v=vhC_T1jkepc

ArKaos Connect

ArKaos Connect allows GrandVJ to receive sound and MIDI from any audio sequencer that support VST plugins like Ableton Live or Steinberg Cubase. The audio host can run on the same machine as GrandVJ or on a different one on the same local network.

The configuration of the connection in GrandVJ is very straightforward : just select the sending VST plugin in an auto-updated list and enjoy the new possibilities open by these interactions : Live Generators can now directly react to the sound of an audio performance, MIDI can be received from everywhere..

Transitions

Transitions, already presented in the last GrandVJ Dev version, have been finalized and can now be used with their full creative potential. As a reminder, transitions provide automated smooth changes between two video clips. They can be activated and parametrized for each cell and/or each deck in mixer mode.

A large collection of transitions effects has been added to the browser library. The choice of the transition is therefore as simple as choosing a normal effect. Each transition can be personalized using up to four controllable parameters plus an extra transition time parameter.

Browser Preview

Video clips, effects and transitions can handily be previewed in a small window below the browser panel. It makes the content browsing more efficient, allowing you to decide which visual, effect, transition, etc. you will use before first applying it to a cell in GrandVJ.

Multi-monitors support on windows

GrandVJ now fully supports multi-screen output in Windows Vista & 7 for Multi-head graphics cards. This means you can connect several displays to one graphic card and GrandVJ will spread the output across those connected displays.

Bidirectional support for Akai APC20

Just in time for the release, we’ve added bidirectional support for Akai’s new MIDI controller, the APC20! It works the same as for the APC40, checkout the doc for more info.

Download the RC2 version:

• GrandVJ 1.5 final has been released, you can get the latest version from the GrandVJ download page

How to install?:

Just run the installer and follow the steps.

However, in order to use ArKaos Connect with a sequencer in Windows, please do the following step:

• Windows: copy “ArKaos Connect VST plugin/ArKaosConnect.dll” into your VST folder (i.e : “C:\Program Files\Steinberg\Cubase 6\VSTPlugins”)

Documentation:

As usual, documentation is provided as PDF in the “Documentation” folder:

• ArKaos_GrandVJ_1_5_ReleaseNotes.pdf (Changes from GrandVJ 1.2 to 1.5)
• ArKaos_Connect_quickstart.pdf (QuickStart guide for ArKaos Connect)

Important:

This is not yet the final release version, it still needs some testing, remember that before using it in front of an audience. We don’t have a release date for the final version yet, it will depend on your precious feedback..

Happy testing!

We first spotted a great home demo on Vimeo that he did after using GrandVJ since just one day, then the week after he was already taking GrandVJ live on stage for the ZôL concert at Metamorphoses, a French Electronic music festival.

Well last week we were at the MixMove Expo for DJ & Club Culture in Paris and we met Charlie Mars there, he was participating to the first France VJ & Videodesigner Championship with our GrandVJ software.

Charlie had to compete with eight other French VJ’s and he won the championship thanks to his talent, his very creative content and.. with the help of GrandVJ.

Read below for his impressions and a few pictures (kindly provided by LeCollagiste – Merci Laurent!).

It wasn’t easy for me to approach a “VJing Championship” because “Championship” relates to sport and sport is not really my thing, because competition means that there is a winner and I don’t really like when there are losers, even if I’m the one who wins, and even though being the winner is kinda cool: it’s a plus for the Ego and motivates for continuing, but ok I digress..

We (the participating Vj’s) were primarily here to defend a discipline that still lacks recognition (some event organizers still think that VJ’s play for free..) and highlight the most creative aspects of VJing, this championship was a great opportunity to do so.

It is always difficult, from my point of view, to judge a creative work on precise criteria, the verdict is necessarily subjective and I think that each participant had its own, well affirmed style. Yes, I saw some very good stuff, the level was high.

Personally, I give more importance to content than technique, that’s why I use GrandVJ; it’s simple, totally stable (very important, especially when like me you have 68 loops per deck on 20+ decks..), with a fast and fun learning curve, but still without forgetting the technical tools necessary to the quality of the projection (frame blending, keystoning, time sync, etc..)

My setup wasn’t anything very complex, an Alienware laptop (Core I7, 4Gb Ram), two MIDI controllers: a Novation Launchpad and a Korg Nanokontrol, my multicolour hood and of course GrandVJ. That’s all I need to have a lot of fun, mix on instinct and cut like a lumberjack.. And that is very good!

DA FACT introduced the Karlax at MusikMesse 2010 as the first controller for digital Arts that re-establish the artist’s body at the heart of the performance. With it’s revolutionary ergonomic design, this instrument transmits the artist’s own natural movements wireless (using radio-waves and MIDI trough USB) to a computer, giving musicians and digital Artists freedom on stage.

Yes, 10 fingers running on a MIDI keyboard can trigger many events, for more flexibility you can also use some advanced controllers especially made for audio sampling software or directly aimed at VJ’s. But as Nintendo showed to the game industry, gestures and body movement can add a whole new fantastic layer to expression and control, as an example just Google GrandVJ+Wiimote and you’ll see that there is really some interest about controlling visuals with gestures.

At ArKaos, we designed GrandVJ so that everything can be controlled by MIDI and we tried as much as possible to make it compatible with any existing or future controller thanks to the MIDI-learn mode. So the Karlax was working out of the box with GrandVJ but we’ve been in contact with DA FACT to develop a better support for their controller in GrandVJ as we did previously with other manufacturers.

In this video from MusikMesse 2010 you see the GrandVJ in mixer mode mapped to the various MIDI notes and controllers generated by the Karlax. In this first implementation we mapped five controllers to the intensity of the first five mixer layers. You can use two keys to select the next and previous layer so you can edit live the state of all layers directly from the controller and the movement is mapped to Loop speed.

The other controls are used to affect loop speed, to trigger visuals from the patch, to select effects or change parameter values, to modify the visual position, etc… The Karlax is here used to control at the same time GrandVJ and an audio application.

Recently we’ve been in contact with Alioscopy, a French company that develops auto-stereoscopic 3D displays that can produce a sensation of depth without needing cumbersome eyewear and they asked us if we could bring live VJing to their 3D screens.

The problem is, even if you are only mixing footage that is compatible with 3D projection you are still missing live visualizers which are, most of the time, a very important part of the mix and which obviously can’t be pre-encoded for 3D projection..

Alioscopy’s 3D display range currently includes 24″, 42″ and 47″ screens integrating a technology that is based on standard Full HD LCD displays but equipped with an array of lenticular lenses. Each lens overlaps 8 different points of view and casts different images onto each eye, allowing for one only to be seen through the lens from any given angle.

Thus to recreate this feeling of depth, a 3D scene needs to be rendered from 8 different points of view and combined to one auto-stereoscopic image. To achieve this, we developed an easy to use auto-stereoscopic Quartz Composition template wherein you can transform your original Quartz Composer composition to a obtain real 3D sensation on an Alioscopy screen.

Integrating support for Alioscopy in GrandVJ through a Quartz Composition template was a logical step since GrandVJ now fully supports Quartz since version 1.2. – and of course, the same integration will also be supported in MediaMaster – But the big advantage of a Quartz template is that it’s fully customizable by the user; you can fine-tune the depth effect exactly the way you want!

When edited in Quartz Composer, the template appears as a layer above the original composition. Descend the patch hierarchy, paste your scene, adapt the auto-stereoscopic parameters depending on your scene and you’re done. The 3D-enabled composition can be used and mixed as any other Quartz Composition in GrandVJ but of course, it must be output to an Alioscopy screen to see the magic happen.

Now we just have to decide how we are going to go to the market with this new development but you should read more about this very soon..

Quartz Composer is a free graphics and imaging tool on the Mac platform which is available as an optional install that can be found on your Mac OS X DVD since version 10.4.

It allows very easy creation of complex audio-reactive animations or effects which can now be played in GrandVJ (read the previous article about GrandVJ and Quartz Composer). As I’m writing these lines, the last version of Quartz-Composer is 4.0 on Mac OS 10.6 (Snow Leopard).

In this article we will demonstrate how to quickly create a bass-reactive Zoom/Blur effect like the one you can see below:

Important: This tutorial requires that you have some basic knowledge of Quartz Composer: if you have never used it, you really should first go through the “Getting Started”. You will also find some helpful readings at the Apple Developer Connection web site about Quartz Composer.

To create our effect we will simply edit Quartz-Composer’s default template named “Image Filter” to make it audio reactive. Basically, we will connect bass levels of the computer’s audio input signal to the “Amount” parameter of our Zoom/Blur filter. (Read more below..)

• Start the Quartz-Composer.app which is located in /Developer/Applications/

• From the menus, choose (File –> New from Template –>) Image Filter :
  

• Here’s the patch that will open:

• In the menus choose Editor –> Edit Protocol Conformance

• We will now tell the ArKaos software what inputs must be transmitted to the Composition. The ArKaos engine can send visuals or sound for processing by the Composition but only if he knows that these feeds will be accepted.
  To enable this you must check “Music Visualizer” and click “Done”

• You’re back to the Composition and several input modules have been added on the left:

• Remove every unnecessary input modules, so they won’t be listed as input parameters in GrandVJ‘s effect parameter panel:

• Quartz composer can hide blocks inside blocks, it’s called macros. It’s very powerful and in this case it holds the most important part of our composition: the processing part, which will affect the visual before copying it to the output.
  Double click on the “Process Image” macro to open it, Quartz Composer details each block contained in the macro:

• We want to connect the audio volume to the “Amount” input of the “Zoom Blur” filter contained in this macro. To do that we need to make the “Amount” parameter available in the macro block so that it can be accessed from the top level, it’s called publishing an input.
  Publish the “Amount” input as in this screenshot:

• When it’s done, we can go back at the top level to add some processing.
  In the top bar, click the “Edit Parent” button to go back the parent patch:

• Now we will add a processing block to create a value from the sound input.
  From the Library, add an “Audio Processor” module:

• You’re back to the patch with the “Audio Processor” module added. The magical thing about Quartz Composer is that you can connect the modules in many different ways, when you add a module you just have to tell Quartz Composer how to feed the inputs and connect the outputs.

• First we want to process the audio received from the ArKaos engine. To do that we connect together the “Audio Spectrum” and the “Audio Processor” module:

• Now the audio processor will create three values from the audio we are feeding, Lows, Mids and Highs. For this effect we just want to use the lower value which is the one reflecting the bass volume. So we connect the Lows output from the “Audio Processor” module to the “Amount” input we just published in the “Process the Image” macro:

At this point we need to get an audio signal so we can test our effect within Quartz Composer. For this purpose we will add an “Audio Input” that we will disconnect in the end so GrandVJ can input its own audio signal into the “Audio Processor” module.

• From the Library, add an “Audio Input“ module..

• ..and connect its “Audio Spectrum” output to the input from “Audio Processor”

Now we can see the image reacting to the audio input signal, but the effect is definitely too low, so we need to boost the audio signal values. A simple way to do that is to add a new processing module, specifically a math module:

• From the Library, add a “Math Module”..

• ..and configure it to operator Multiply, set Operand #1 to value 100:

• Connect the Lows output from “Audio Processor” to “Multiply” then connect “Multiply” to the “Amount” input from “Process the Image”

• You can now disconnect the “Audio Input” from the “Audio Spectrum” so that, once this composition is loaded in GrandVJ, the software will automatically send the audio input signal directly to “Audio Spectrum”.

• Finally save the composition as “MyBassZoomBlur.qtz” in /Users/MyAccount/Library/Application Support/ArKaos/GrandVJ/Quartz Composer/Effects/

Now is time to start GrandVJ and find your hard work rewarded by playing with your very own brand new effect. You will find it located in the Effects panel under the “Quartz-Composer (User)” effect category.

Notice how GrandVJ has made available the X and Y effect parameters from the Composition in the Effect parameter panel so you can use them to control the behavior of your effect in real time.

Now, that wasn’t hard, was it? If you want to go further, a good start will be to create new effects based on this Composition by replacing the “Zoom Blur” effect by another filter.

Don’t hesitate to share your creations on the forums :)

Meanwhile we have released GrandVJ 1.2 and we took the time to include a special template for the Ohm64 in this release. As we did for the Akai APC40, this new dedicated template allows even more bidirectional communication between both products and takes advantage of all the control and feedback possibilities offered by the device.
It’s just like if your GrandVJ was made for your Ohm64.. and vice-versa :)

And thus, below is a new video from Livid showing their controller in action with GrandVJ:

One thing that appears obvious to us after more than 10 years of working with the various solutions that can be used on Mac and Windows to decompress video is that not all solutions are equal.

We believe that our users should be able to play almost any kind of media with the ArKaos software and at the same time we do everything a team of developer can to get the best performance on the platforms supported.

Practically the ArKaos software can play media files through the following decoders: QuickTime, FFmpeg, the Flash plugin, Quartz Composer and Windows Media Player. Currently (December 2009) we don’t allow the user to decide through which solution a media will be decoded, instead we try to make the best decision based on our many years of experience and tests. In the case where several video codecs (such as Mpeg4) can be played through different decoders like QuickTime, FFmpeg and Windows Media Player, we always prefer, no matter the platform, to first try to handle those codecs with FFmpeg as we have always had the best results with FFmpeg during our tests, and here’s why..

The other solutions..

Of course, on the Mac we could stick to QuickTime.. But sadly it appears that QuickTime has become almost obsolete today and is just used to decompress the codecs needed by the iPods. Most codecs are not properly multi threaded in QuickTime and this is a big problem for us. With GrandVJ or MediaMaster taking advantage of multi core machines by using each core separately to decompress the video layers you are mixing, it’s too bad to miss that great improvement by playing videos that absolutely need the QuickTime support.

On the PC we could be using Windows Media Player, it is a wonderful technology but it’s architecture is completely incompatible with the sophisticated engine we use to allow frame blending and frame prediction in the latest version of GrandVJ and MediaMaster.

Flash animations and Quartz Compositions, of course, are unique in the sense that they can only be read by their own dedicated player.

As you now understand, once you open a media file in ArKaos your content can go through various roads and it’s important to consider that. To get the most out of GrandVJ or MediaMaster, benefit from the advantages of multi threading and perform frame blending you should make sure that your content is always played through FFmpeg.

How does ArKaos process the movie file?

On the Windows platform it’s pretty easy because the software first tries to play a file with the FFmpeg player and then falls back to the others (Windows Media Player or QuickTime) if needed.

But things get harder with the Mac platform because some files that could be played by FFmpeg may be rejected and fall back to QuickTime just because they have not been saved the correctly. Many QuickTime files have been created in a way that make them compatible with Mac OS X but also it’s ancestors Mac OS 9 and 8 and 7 and… Those files make use of what is called a Resource Fork.

To make it short, when Apple introduced the Macintosh years ago they decided that a single file would in fact be two files: the data file itself and an optional resource file. Many software have been using that Resource Fork to store additional data and information. This is now a problem for many .mov files that were created in the past and even still today with some applications that were born under the Mac OS 9 era and still generate QuickTime .mov files that have a Resource Fork.

This is quiet an issue for us because when the FFmpeg decoder can’t handle those files and makes ArKaos fall back to QuickTime, you end with QuickTime’s very bad multi core support even for very common codecs such as Photo JPEG. Another bad side effect of this Resource Fork is that most of the time when you will copy a movie file that has a Resource Fork to a Windows or Linux machine it will simply not be readable anymore because that tiny bit of information contained in the Resource Fork is not read on other platforms although it is vital to play the content.

How to get rid of the Resource Fork?

Thankfully it’s very easy to remove that annoying Resource Fork from a QuickTime file. You can simply open the file in today’s QuickTime player and do a “Save As”, QuickTime will reprocess the file correctly. The process is called “flattening” a movie file, it is very fast and will not re-compress your movie, this is very important to avoid re-compressing when possible.

Open your file in QuickTime and go to File, Save As..

.. and enter a new name

Of course, you will only need to do that if your file was created on a Mac, the free version of the QuickTime player is enough to do this and it works on all Mac OS X versions up to Snow Leopard with the latest QuickTime player. Now if you have lots of movie files to convert, you can of course look for some professional software that can queue and “flatten” a bunch of files from a directory.

FYI, here is a QuickTime file that has a Resource Fork (moov), inspected with a programming utility called Resorcerer:

And here is the same file that has been flattened:

How do I know what decoder is used?

In GrandVJ it’s very easy to see what player is used by the ArKaos engine when processing a file; simply hover your mouse over the cell that contains the video and the contextual help appears.

In this one, the video file with a resource fork will be played through QuickTime:

In this one, the same video flattened with the QuickTime player will go through the FFmpeg path:

(The same information is also available in GrandVJ for each movie listed in the visual library and in MediaMaster you can get that information from the file library window.)

Conclusion

During the first days of the release of GrandVJ 1.2 beta 3 with the new audio engine (which relies on FFmpeg) some users have complained that some old .mov files were not playing audio correctly with the beta version, this was most of the time caused by the Resource Fork and flattening the files fixed the problem. As a bonus, it will make your files cross platform.

This should give you some lights on what is happening when you drop a file on GrandVJ or MediaMaster, as you can see a lot of work is being done under the hood :)

We’ve been a bit quiet lately but we’ve been working hard trying to move sound support from the old system (based on QuickTime) to an implementation using FFMPeg. This is because the QT support is getting worse and worse and we think it’s important we move to a more controllable medium.

The Beta 3 released last week on our forums contained the first result of this implementation but wasn’t very smooth or even stable especially with backward/forward playback.

The Beta 4 fixes the backward playback bug and relies on a new FFMPeg build that supports AC3. This means you can now drop VOB’s & MKV and get proper audio running… If the vob is 5.1, we also do stereo mixdown.

Surf to the forum post for more details about this Beta and the download links..

We have optimized the Quartz Composer integration in GrandVJ 1.2 so that the compostions are rendered natively through the fastest available interface.

Finally, when using a composition as an effect the application will scan the published inputs and map them as effect parameters, if the format is compatible with the engine. GrandVJ can automatically map parameters that are float values, indexes, colors and booleans and there’s one visual input of the composition that receive the cell visual.

Now let’s have a quick look at how you can use Quartz compositions with GrandVJ..

Using compositions as sources

The quick way to use a composition as source is to import it just like you do with any movie, by drag and drop on a cell or by reaching your .qtz through the file browser. When doing so, GrandVJ will save the path to the .qtz file in your project as it does for any other visual.

For your convenience, GrandVJ installs a set of source compositions in “/Users/<username>/Library/Application Support/GrandVJ/Quartz Composer/Visuals”, these are listed in GrandVJ under the “Quartz-Composer (User)” section of the sources browser so that they are always available when you create a new project.

The idea is that you can also add your favorite source compositions there so that you always have them ready when you work on your projects.

Playing compositions as source does not allow modifying the variables from within GrandVJ.

Path for user compostions as Sources	User compositions as Sources

Using compositions as effects

System compositions as Effects

For effects, GrandVJ will add all the compositions from your system that are supported. It does it by automatically scanning the system folder “/System/Library/Compositions”. These compositions will appear in the application under the “Quartz-Composer (System)” section of the effects browser. You can use them as starting point to develop new effects. You can also add your own compositions as effects, just drop them in the local directory “/Users/<username>/Library/Application Support/GrandVJ/Quartz Composer/Effects”. They will appear in the “Quartz-Composer (User)” section of the effect browser.

Path for user compostions as Effects	User compositions as Effects

About the parameters

As a quick example, let’s have a look at the effect parameters from the system composition Image Hose. With the Quartz Composer application (found in Developer > Applications – you need to have installed Apple’s developer tools of course), open the file “/System/Library/Compositions/Image Hose.qtz” (ore better, open a copy) here’s what you should see:

Image Hose composition

Open the inspector (Editor > Show Inspector) and from the menu, look at the Published Inputs & Outputs, here’s what you have:

Image Hose composition parameters

In GrandVJ, the first 4 parameters that can be mapped automatically will be displayed. In this case it will be PrimaryColor, SecondaryColor, Pace and Size:

Quartz composition parameters in GrandVJ

As you can see, GrandVJ will only display the meaningful part of the parameter name and remove all _ProtocolInput strings from parameter names – this allows to easily display the full parameter name in the panel – it will also make things a little nicer by capitalizing the first letter of the parameter if necessary.

There are many resources on the web where you can find information and help about creating your own Quartz compositions, you can start by looking at Apple’s Developer Connection.

Note: you can download GrandVJ 1.2 beta 2 from our forums