Some notes towards a project I’d like to do. I think turning our paths through the world into collaborative auditory maps would be a wonderful thing.

Exploring links between music and mathematics in a networked mobile system

This project would develop software capable of analysing the positions of a group of learners relative to each other and streaming music generated computationally using the qualities of the group’s shape back to each learner, allowing members of the group to receive auditory feedback on the shape of the group, and to manipulate the audio stream through positioning their bodies differently in space.

For example, five learners, each with a mobile device capable of broadcasting its location (through GPS, network triangulation or similar), might be the vertices of a five-sided polygon, as imagined from above. Qualities of this shape – the interior angles, the length of the sides, the regularity of the shape, the surface area it covers, the length of time the shape has persisted – could map to musical features – dynamics, frequency range, degree of polyphony, range of instruments, different thematic material, degree of harmony – that could be used by software in generating a musical response.

The software would be designed to enable the precise nature of the correspondence between geometric quality and musical feature to be set by users themselves, allowing learners and teachers to explore the connections between the shapes made in space and the ways they can be analysed to an appropriate degree of complexity, and to represent the relationships between shape and harmony in the way they feel is most appropriate. Regular shapes might lead to more harmonious music; shapes sustained for a longer period might be louder than those that persist only briefly; serendipitous figures might be rewarded with specially-chosen vocal samples; learners might be guided towards target shapes through more attractive or moving musical forms; basic musical rules might be used to chart the stochastic movements of students travelling home, producing auditory geographies of familiar territories: a school song might be written by the movements of a victorious sports team during their final match.

The pedagogic value of this system might lie primarily in the capacity for supporting cross-curricular exploration, the participatory design of learning activities by learners themselves and the opportunities it presents for learning across age groups, with more able or older students preparing geo-acoustic systems for younger students to experience, or technologically more fluent students realising other students’ ideas about the relationships between shape and music.

Additionally, from a research perspective, the embodied nature of learners’ interactions within the geo-acoustic system is modally distinct from more usual forms of interaction with these subjects and presents an interesting and novel set of questions around the ways in which intellectual understanding relates to physical bodies, as well as being an opportunity to foreground current issues in education debates, not least perhaps the opportunity to explore more rigorously popular notions of “kinaesthetic intelligence” and to promote physical activity within an educational context. The nature of the activities designed by teachers and learners might well resonate with current interest in the potential educational value of pervasive and augmented reality gaming.

Despite this interdisciplinary focus, there are a number of traditional subject areas addressed in the development and use of such software. The following list is indicative rather than comprehensive.

• Geometry — understanding the ways in which practical geometry abstracts shape from the physical world and the language mathematicians use to describe geometric shapes and relationships
• Acoustic theory — models of synthesis, tone and timbre
• Music — composition, generative approaches to music creation, music theory
• Computer science — understanding networks, representing and manipulating variables using programming languages
• Psychology of perception — making sense of the world through auditory cues, proprioception and mental schemata
• History of science — Pythogarean notions of order and harmony, and how far these relate to current ideas about the way we understand the natural world to be ordered

Additionally, exploring the possible activities that this software might support could lead to explorations of the ways in which information can be presented through sound (sonification) and the various groups in society who might find this approach to sharing information about their environment beneficial, as well as supporting conversations about sound design in media, noise pollution, the ethics of location-aware software and the ways in which people’s individual actions contribute to larger effects.

On Sunday I got myself down to the Arnolfini for Interesting Sounds, an event that grew out of Russell Davies’ Interesting events. I couldn’t stay for the whole day, unfortunately, but what I saw was fantastic. Adam Harding showed us his reconfigured guitar, moving the essential parts into a rectangular board that can be played like a dulcimer: the distancing effect of changing the relationship between player and instrument suited his delicate abstractions. Jon Pigott showed us the Sonic Marble Run (see video below).

Grace showed us a video of the Dynion Dance Group dancing on Swansea’s Sail Bridge, choreographed by Paul Granjon. Matthew Olden demoed the latest version of Jungulator. Allen Argent showed us more MaxMSP madness, with a set of patches enabling collaboration and control across networks (my favourite was Netverb, which added reverberation effects computed from the shape of the network: echoes from a virtual room whose walls are made out of TCP/IP packets). We saw John Wild’s Sounds from the Perimeter Fence, recontextualising the site of the Olympics: gorgeous, bleak sounds, as you can see below.

I talked a little bit about an idea I had for making it nicer to be outside in cities:

- it’s all a bit jumbled at the moment, but I’d like to try making an antibeep and see if it works. I tried to make one using two Buddha machines, but it didn’t really work.

And then I just had time to see David Hanford’s Sound Chair (a thirties chair with speakers in the back and base and controls on the arm like a supervillain, intended for the subsonics produced from the beats of two analogue oscillators) and Tom Bugs demoing his analogue intricacies, it was lunchtime and time for me to go home.

I missed most of the rest of the day, but I think video and audio from the day will be up at http://www.interestingsounds.com/ soon. Can’t wait for the next one.

The title is bigger than this thought: just want to get it down before it flies away. We can, with our location-aware devices and our addressable objects and our ambient interactions and our wireless connections and radio flying around everywhere, rid ourselves of screens and touchpads and styli and become the pointer ourselves. We can play the city with our bodies the way we can play a theremin with our hands: by being in this place and not that one.

When I was in Singapore working with the Zoo using mediascapes, I had a dream of marking out a giant touchscreen interface, with a start button and menus and buttons, on a football field, and using the software to let people become the mouse pointer, opening files by running across real space and clicking buttons by jumping on them (accelerometers in pockets).

I’ve been talking to various people about a game, Resonance, that involves arranging yourself in shapes with other people and casting spells using your bodies as glyphs on the nodes of the pentagram, weaving superstition and magic and the occult together through space and concrete. They’re not talking about exactly the same thing, of course, but Dan Hill and Matt Jones are lumped together by Bruce Sterling as being heralds of a new pervasive urban alchemy, an open sorcery revealed through lumps of plastic and metal. I’m encouraged by the sympathy between Resonance and their more thoughtful perspectives, but I kind of still wish I was the only person making Kircherian links between these technologies and older ways of knowing the invisible. I am rubbish at sharing.

I met a spiritualist tonight. We were in a busy pub, camping a table, and he sat down as we did: of course, at the time he was just a person we didn’t know. Later, though, we got talking, and it turned out he’d come down from Ayrshire, via the Wirral, to join around 500 people, in a place I’ve been impolite enough to forget, in order to watch a noted mediun — “you’ve not heard of him?”: no, nor remembered his name a few hours later — and, hopefully, hear from his mother, dead these past eight years; he and his mother were close, he said, holding up his crossed fingers. When there’s someone ready to speak from the other side, there’s a kind of light bulb appears above their head: the people speaking don’t get older or change their views because time doesn’t really mean the same thing on the other side.. On his wrist he wore a copper bracelet with a Greek repeating design, to help his arthritis.

He impressed me, this man who believed things I’m used to hearing mocked, and although I didn’t feel impelled to join him, nor alter my belief that harking after people who have left isn’t healthy, for them or you, I still couldn’t articulate my own beliefs with a confidence equal to his: when asked if I believe in eternity, I could only muster a mealy-mouthed sophistry to the effect that I believed in infinity. I was impressed not by his ontological views but by his lack of evangelical zeal, and his quiet but firm belief in the importance of being master of your own mind and subject to no group’s insistence on a particular way of thinking. “I believe in freedom of mind”, he said, and so, I thought, do I, but only one of us has the courage to test it.

Of course, freedom of mind is a flag under which a motley crew might fly, and I excused myself once he began to explain that Darwin was wrong, not wanting to hear anything which might temper my fine opinion of his polite and cogent way of talking. But he lacked the shine and sparkle of the zealot: his grey hair was neat but not strict, his manner assured, his whole demeanour lacking the excessive normality of someone trying to convert. I don’t know what he’ll experience tomorrow, but if he hears that his mum’s doing ok, then I don’t see how that can be censured, and I hope he hears she’s well.

Earlier today I met a man who has venture capital for colonising the moon. My references may be a little adrift.