Research with Rokoko Motion Capture Suits, AR Magic Leap Glasses and a LOOP APP developed from Nico and the Navigators.

Where: Berlin, Germany

When: 29.8.-4.9.2022 28.11.-4.12.2022 in presence and in the meantime with free time allocation

Deadline for applications: 5.8.2022

For the past year, the DOCKdigital LAB has been experimenting with motion capture suits from Rokoko – data suits that digitally capture movements of real bodies so that the data can be processed for further use. The motion capture suits can therefore be perfectly combined with Magic Leap glasses. In order to bring these two technologies together in an uncomplicated and flexible way, Oliver Proske and Moritz Kiefer developed the AR-Loop-Machine. With its help, dancers can, for example, develop a pas de deux with a 3D image previously generated from themselves. The audience sees the dancers in real space and, with the help of AR glasses, their animation, which seems to merge with their original in the dance. This technological innovation is made available within this residency so that it can be extended with avatars and explored in further directions.

The goal of the residency program is to expand a network and foster collaboration between 3D, game, systems designers and media artists with chorographers, movement researchers and performance artists.

Another goal of the residency is the further development of the AR-LOOP-MACHINE with avatars / sculptures.
So far it is only possible to make motion capture rococo manikins dance.
Another goal is to assemble and train teams to offer workshops, tours or labs with the AR-LOOP-MACHINE.

Researching artistic relevance:
What artistic relevance do we see in working with the AR-LOOP-MACHINE, for example, if it could be combined with creatures, if artists and their movements could change in gender, skin color, size, etc., thus enabling a play with identities. The transformation of dancers into sculptures that make their imaginary worlds, feelings, energies, etc. visible in dance would also be a research topic. The avatars of the LOOP-MACHINE can dance with suspension of gravity and all physical laws. Avatars or body parts can merge into each other and modify in all directions. It can also change the textures of the surface. The states of aggregation or particles can also be varied A research topic would be to add or remove live or pre-produced figures and beings to the performance.

The AR-LOOP-MACHINE can be connected to all other technical digital capabilities of the DOCKdigitalLAB. This includes, for example, creating 3D sculptures with the HTC VIVE VR glasses with 3D drawing software. Nico and the Navigators is providing 30 AR glasses and AR-LOOP machine programming to this residency program.

DOCK digitalLAB is providing motion capture suits from Rokoko, HTC VIVE trackers, high-performance computers, and space.

August 29, 2022 to September 2, 2022 (attendance required).
Introductory workshops in presence
August 29, 2022 | Monday
10-12 Introductory workshop
12-13.30 Movement Research
14.30 17.30 Presentation AR LOOP

August 30, 2022 | Tuesday
10-12 a.m. Movement Research
12-14 h Motion Capture
14-15 Break
15-17 h Motion Capture

August 31, 2022 | Wednesday
10-12 am Movement Research
12-14 pm Iclone | Character Creator
14-15 h Break
15-17 hrs Iclone | Character Creator

September 1 | Thursday
10-12 am Movement Research
12-14 pm Game Engine
14-15 break
14-16 h Game Engine

September 2 | Friday
10-12 am Movement Research
12-14 h AR LOOP MACHINE / Concept Development
14-15 h Break
15-17 h AR LOOP MACHINE / Concept Development

September 2-5, 2022
Concept development, brainstorming, formation of working groups
Rehearsal times in room 4 on request
Use of motion capture suits, high performance computer, and Magic Leap glasses upon request.
September 5-11, 2022 (attendance possible during the whole time and required on a daily basis)
In Room 4, 10-30 pairs of glasses will be installed and the piece “You Must Render Your Life”
by Yui Kawaguchi in cooperation with Nico and the Navigators will be set up.
We expect a testing period with technical problems and solutions.
September 12-18, 2022 (attendance possible throughout and required by the day).
Setup and Research
Move to the theater. Research with set-up of 30-60 glasses.
Set-up, supervision of VR, AR, AI projects in auditorium 1-4.

(Here it is also possible to apply as technical staff as well as assistance. Because services beyond the job shadowing will be compensated extra. Please send applications to
September 19 to November 27, 2022 (free time allocation)
Creation phase in Berlin or also supra-regionally with own time allocation.
Use of AR-LOOP-MACHINE, motion capture suits, high performance computer, Magic Leap glasses, as well as other equipment and use of space on request.
Mentoring (10 hrs. per group), technical support (10 hrs. per group), additional workshops on request if necessary.
November 28 – December 4 (attendance required)
Presentation in Studio 300 at EDEN or Room 4.
Results/intermediate outcomes of residencies, labs, workshops will be presented at EDEN from November 28 to December 4, 2022.
Further presentation formats will take place at the same time as GalerieWEEKENDs and ART WEEK in Berlin.

How to apply:
Who’s For:
The call is open to 12 individuals from the fields of.
Game, System, 3D Design as well as Movement Researchers, Choreographers or Performance Artists.

Within the residency, working relationships at the intersection of body and digital art should develop, allowing independent work with technology.

Also, if the times do not fit, we welcome applications; if necessary, we can offer additional labs at other times.

Each of the 12 applicants will receive 600 Euro expense allowance or honorarium.
In addition, it is possible to participate additionally paid as an assistant at the festival.

Name, first name, address, email, phone, web-side, date of birth, place of birth or nationality.
Experience with Magic Leap glasses, AR development, ….

CV with links to references
Letter of motivation

Send to by August 5, 2022.
Response. August 15, 2022

If there are scheduling difficulties, please apply anyway, we may offer additional labs. Interested parties, with a theoretical background are welcome to join the research phase.

Organizers and universities are welcome to request workshop formats in areas such as AR, VR, motion capture, AI.

Gefördert von der Beauftragten der Bundesregierung für Kultur und Medien im Rahmen von NPN | Stepping Out | Neustart Kultur

Contact details:

For further information, please visit