Experimental motion capture for beginners by Juha Fiilin

Juha Fiilin Experimental Motion Capture For BeginnersAnirey Seminar, Reykjavik, March 2015

My background Filmmaker and a graphic designer with focus on film.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Teaching background Various courses and workshops about film graphics and visualization for both film and graphic design students.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Challenge How to build a situation where the graphic designers were creators together with the film students?

A course, where both film and graphic design students would learn something completely new and create something together.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Idea was born…Experimental motion capture for graphic design and film students.

Initial concern Writing a story would take too much time.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

SolutionUsing an existing story to speed up the process.

I proposed a story, Divine Consultants, an animated scifi comedy series (10x10 )́

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

My story was in development, and therefore I felt comfortable having it “hacked” by the students

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Story logline Oogle and Joy swear eternal love, but can the love last when the couple is faced with Heaven's and Hell's terrible secret and the destiny of all mankind?

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

I had created a strong visual look for Divine Consultants, but to make the course engaging and experimental for the students I would have to give the student free hands.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Oh... Divine Consultants is also a casual game in development (since Nordisk Panorama Hackathon).

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Planning the course Got go ahead from both film and graphic design departments.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Main challenge Students have no prior knowledge of mocap or even video.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Importance of the first day Re-writing the brief Keeping it simple Engaging students from day one

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 1  Kick start - the brief Sketching characters individually Presenting character sketches Forming groups

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Presenting character sketches

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 2More detailed brief - create a film scene of 30-60 s.

Working in groups Reading script together, selecting and editing scenes Storyboarding

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 3Creating each group’s own visual style Sketching characters and environments in groups

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 4Touch point with all tutors and groups

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 5Preparing 2d characters and environments for Motion Builder

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 6Introduction lecture to mocap technologies by Tanja Bastamow

Day 7Entering the motion capture studio

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Mocap best practises lecture by Max MäkinenJUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Actors try out the motion capture suit Learning A and T pose and setting up Cortex Motion Analysis

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

All students try out the virtual camera

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

All students direct the actors

Groups decide the roles for the capturing director

camera operatorassistant directorlogger

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 8First shoot day First two groups capture their scenes Film Director students help as assistant directors

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Group “End of the Road”

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Group “Endless Bar Limbo”

Day 9Second shoot day Two more groups capture their scenes

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Group “Eternal Limbo”

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Group “Mr O”

Day 9 All groups start editing their offline video

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Offline editing

Day 10All groups finish offline videos Motion data cleaning can start

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 11 and 12Data cleaning continues

Groups prepare their assets

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

First groups start editing 3d scenes with Jouko Manninen and Shareef Askar

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Other groups fine tune their characters and environments

Day 13First renders of the scenes

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 14Crash course to compositing in After Effects by Leo Liesvirta

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 14Passing first renders to compositing

Day 14Touch point with all tutors and groups

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 15Fixing problems with problem-solving-based-tutoring

Re-rendering erroneous scenes Dividing scenes and assets for all group members

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Day 16 to 20 A work, work, work week. Compositing Editing scenes together Editing sound and music Creating titles and credits Rendering finished projects

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Compositing

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Rendering comps

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Editing scenes together

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Synchronizing and editing sound

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Fine-tuning projects in groups

Day 21Screening the results at Aalto University Final critic

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Mr O

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Eternal Limbo

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Endless Bar Limbo

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

End of the Road

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Learnings Graphic design students learned team work, which they apparently don’t do much.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Learnings Many tutors were needed for such a crash course, which made this course a relatively expensive one.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Learnings Students Art Directed the 3d animators – yet another task graphic design students aren’t used to do.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Key learning Students work hard when they take ownership of their project.

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Thank you!

Q & A

JUHA FIILIN: EXPERIMENTAL MOTION CAPTURE FOR BEGINNERS

Juha Fiilinjuha@fiilin.com+358 440 878 900