July concall

Center for Behavior Imaging @ Georgia Tech

July Concall

Jim RehgGeorgia Tech

July 3, 2012

Agenda

• Summer School Recap

• Grand Challenge Update

• Annual Reports

2

First Expedition Summer School

3

Observation of CfD Students

4

Lectures and Labs

• Psychology of autism– Lectures on

development, diagnosis/treatment, outcomes

• ANS– Live recording of EDA with Q sensor– Experiment with basic filtering of EDA signal– Lectures on physiology and autonomics

• Speech– Experiments with speech data (live and recorded)– Pitch tracking and formants via Praat– Word spotting using Nexidia

5

Lectures and Labs (cont)

• Vision– Experiments with captured video and Rapid-ABC

– Face pose and smile analysis using Omron SDK

– Predicting discrete smiles and response to name

• Accelerometry– Live recording of accelerometry data

– Experiment with developing a pedometer

– Lectures on modeling and processing accel. Signal

• Group discussion session

6

Student Comments

• “…it was a very fruitful and motivational experience to discuss my own research and future work and develop ideas for cooperation and integration into multimodal frameworks.”

• “A great opportunity to become familiar with the Center and ASD.”

• “It was a great opportunity to get to know our team (as well as understand them)”

7

Strengths of Summer School

• All students did hands-on experiments with all major modalities in the Expedition

• All students had opportunity to observe individuals with autism in a natural setting

• Exposure to broad range of tools across modalities

• Building connections between students at different sites

• Excellent venue (the CfD team were impressed)

8

Areas for Improvement

• Better faculty participation across summer school period

• More focus on multimodal integration

• Use of a common, Expedition-focused dataset across lab projects

• Larger, more ambitious student projects with more time for collaborative work

• More time for discussion

9

Discussion Points

• Next summer school should include more non-Expedition participants (faculty and students)

• There is value in having an annual meeting which brings Expedition students together

• Can the summer school fulfill both roles?

• Should we strive for access to a broader autism population?

10

Agenda

• Summer School Recap

• Grand Challenge Update

• Annual Reports

11

Timeline (Modified)

• July 1 – Integration of completed modules begins

• July 15 – Testing results for modules reported to team (GT)

• Aug 15 – Evaluation of integrated modules (GT)

• Sept 1 – Deadline for integrated systems

– GT testing

• Sept 27-28 – Year 3 Meeting

– Presentation and discussion of Grand Challenge results

12

Current Modules

• Keyword spotting on clinician speech (GT)

• Acoustic features and segmented speech (GT)

• Acoustic features and ground truth (USC)

• Ball and face tracking (BU)

• Face tracking, gaze estimation, smile strength estimation (GT)

• Kinect head tracking (GT & BU) – In progress

• Prediction of smile score (GT) – In progress

• ANS analysis (MIT & NE) – In progress

13

Items

• Missing kinect data and lack of ANS synchronization in some early sessions– These issues are being addressed in more recent

captures

• 8 recent sessions are being set-aside for testing purposes– We plan to add 2 more by end of summer

• Each site needs to identify a point of contact for testing the integrated modules

14

Next Steps

• Our goal is to have analysis results from each site in the final competition

– Please let us know your plans!

• Multi-modal analysis can start now, let us know if you are working on predicting engagement ratings

• Finalizing all completed modules, uploading to repository, and integration into ELAN.

15

Agenda

• Summer School Recap

• Grand Challenge Update

• Annual Reports

16

Annual Reports

• 2012 annual report is now due

• Each site is requested to submit their annual reports by July 31, 2012.

• After submitting your report, download the entire PDF from Fastlane and send it to Stephanie

• The GT report will include a description of integrated activities across the team

17

Questions?

18