Aoyagi Lab Colloquium - 2015-05-11

Aoyagi LabColloquium

Activity Data Renderer

2015-05-11 ~ Michele Bianchi

1.The problem

Taking a look at the problem and the proposed solution

The problemWe would like to represent in 3D datasets of human activity, understanding how the body

blocks radio waves during such activities.

Proposed Solution

Use an already available engine with skeletal mesh control to render the data and the body

coverage

Unity3D 5

Famous between indie game developers for its ease of use.

Skeletal mesh control capabilities and scriptable using C# and JavaScript.

The engine itself is not Open Source but the script files for projects can be Open Source

Unreal Engine 4

Last version of a very famous engine in the Industry.

Skeletal mesh control using C++ and Blueprint.

The engine is Open Source (github), so all the project can be Open Source

2.Solution

The proposed solution and what has been done by now

InputDatasets representing the distances between different articulations (e.g. shoulder to wrist, hip to ankle) per time frame.We can convert these distances in angles for each in-between articulations.

Input and output of the program

OutputActivity animation applied to a body skeleton.Using dynamic meshes we can render in real time the body coverage for each sensor node.

How does UE4 with skeletal mesh work?

Integrating a skeleton definition, a skeletal mesh and an animation blueprint it is possible to control each “bone” of the skeleton

BlueprintNode Composing Scripting

Problem

Started working on the control of a skeletal mesh by directly modifying the skeletal nodes using a Blueprint animation.

What works on an animated mesh added by the wizard is not working on a mesh without animation.

3.Future work

What I am doing, what I am planning to do for the project

Official TuorialsUE4 C++ Development

Future work

Control Skeleton through C++ (arbitrary)

Transform datafile in angle streams

Render body occlusion

Define a file structure for future uses

Thanks!Any questions?

@Jazzinghen

[email protected] / [email protected]

Presentation template by SlidesCarnival

SlidesCarnival icons are editable shapes.

This means that you can:● Resize them without losing

quality.● Change fill color and opacity.● Change line color, width and

style.

Isn’t that nice? :)

Examples: