Behavior Demonstration User Community & Incentives If we build, will they come (Well of course)
Feb 12, 2016
Behavior Demonstration User Community & Incentives
If we build, will they come
(Well of course)
Community of User Types• Situation Creators
• Demonstrators
• Annotators & Observers
• Gods (Goal Ontology Managers)
• Viewers
Situation Creators
Situation Creators: Situation Publishing
Situation: Asking girl out in a bar
Location : Bar
Roles: a) Bartender
b) Hot Girl
c) Other Agents
d) BoyScript for Hot Girl: You enter a bar to have a drink or two. You meet a boy there who asks you out…….
Script for Boy: You enter a bar to seek out a girl. You find a hot girl there………
Able to create situations / stories, which others act outDescribe situation using:
–Text–Object placement / mental states / etc –Could specify Goals which must be achieved by characters
Incentives: Situation Creators• Ability to Publish situations to others
• Situations get Ranked– new Innovative…scenarios get more credit
• Higher rank means – Access to more items (props)– Ability to create own items– Greater visibility in community– What else
• Its FUNNN………time, – People create situations for their friends to act out in….., – local small communities (like Peng, Sooraj, Santi…, the anime club) collaboratively
carrying out situation+behavior authoring
• Don’t underestimate people’s willingness to be creative, – (why do people create documents on wikipedia, sims, mods etc)………, People like to
create…………, and OWN it
• People get prizes sponsored by these different companies for the top level behaviors (TBS like companies)
Situation Publishing
Once the situation is published people in their groups (either formed online or beforehand) can teleport to the location created by the situation/scenario author
Behavior Demonstrator
Demonstrators
• Act out a situation
• May not necessarily Annotate the behavior
The million dollar question again: Why ????????
• People who are able to act out “published” situations well enough get credits???,
• praise from their friends
Same logic, people like to be creative, want their characters/avatars to learn how to act properly in these situations
The million dollar question again: Why ????????
After N situations demonstrated, is promoted to Creator (able to create situations) ???
• Community judges how well their avatars/characters have acted in the situations…….
• Community ranks the demonstrations
The million dollar question again: Why ????????– Higher rank means access to community
library of behaviors• People who have made who have acted well can
apply as behavior demonstrators……, a gradation system within the community of behavior demonstrators…….,
• People who are good demonstrators graduate and are able to work on better characters (like Mickey Mouse)….,
– As community uses behaviors, this increases rank
• The top level demonstrated behaviors go in the centralized repository and people whose behavior go into the centralized repository get credited………,, and are the owners of those behaviors
• Able to edit the centralized behaviors
Behavior Demonstrators coupling as trainers for others
• Some people will become expert in behavior training where they can train characters owned by other people in different situation making them proficient
• These behavior trainers will be paid of course…
• Why these behavior trainers???....., people would find it difficult to train, lazy to train and would be willing to pay small amount of money to train them by others
Behavior Annotation
Annotators & Observers• Describe behaviors by annotating• Observers: can simply be watching behaviors,
and “guessing” the behavior –an Improv Game• Incentives:
– Appropriate interpretation ranked by community– Rank increases by how many times others use the
described behavior– Recommend a behavior to someone and part of it is
annotating during recommendation– Getting the annotation during reuse of behaviors by
other authors– People make suggestions on what the behaviors are
doing serving as a feedback for the first level annotation
Annotation Tools:
• System can auto-complete suggestions• System can suggest possible annotations
– Based on similar past behavior, or similar sequence of low-level goals
– Based on user-selected context• System can determine middle-layer
annotations given low & high level annotations
Improv Game• Recorded Simulation (s) and time series of action
available for annotation for the annotation game • www.espgame.org
• Agreement achieved similar to the ESP gamesAND/OR
• What other models can be used for annotation??• Discussion on how In World Annotation could
take place
Gods Ontology Managers
Gods – Ontology Managers• We need a solution to make sure goal ontology terms are
agreed upon (we need Ontology managers)• Able to create goals for characters, to be used by
annotators• Annotated goals can only be the ones that have already
been approved by them or could be the one that will have to go through their approval
• So everything that can be done in the virtual world is either approved by the GOD or needs to be approved
• Incentives:– Ability to determine what is in character’s minds– Owners of parts of the (mental / physical) world
Viewers
Different Participation Scenario as a form of game
• Screening Room like a musuem exhibit and like a live show where the user can act as a viewer and view the situation small stage shows and judge the following (May be some situations are interactive)– How well the actors are acting– How good are the dialogs – How good is the play– How good are the locales– Judge them
• Type of Awards…..: for most populate shows…. • Economy Model: Tip the people if you like the situation
(% value our returns )• Companies can sponsor these awards
Important Character Interaction• Interact with important characters ( like Mickey Mouse….)
– ORRRR interact with them in a particular situation of your choice (SOOOOOOO………., not a free formed input)
• See the interaction between any two characters in a situation of your choice – Mickey Mouse and Georgia Bush in a dating situation– Sort of like an interactive drama…., where u can put them in
different situations– Give different goals to these different characters and see
how they act out in these situations– Picking up characters and creating different situations out
of it….., sharing type situation where people share situations
Economy Model
Economy Model• People can trade in their authored characters, so
that new people can buy characters who are ranked high in terms of expressive behaviors, are able to act well,
• (and we get a royalty out of that sale )• Companies can buy authored characters for their
games created within SL or somewhere else lik EA, websites etc..
• The more highly ranked user / situation / behavior, the more expensive it is
• ( We need a backend that can support all of this)
Character Bidding
• Bid for creating very important characters (e.g. Bush, Mickey Mouse) etc…., – situation for them – act as demonstrator for them
• Buy behavior libraries • You advertise that u need a character
and people bid for it
Misc Other Features
Observing Behaviors (1/2)• Users can join together to create “Plays”
– Set designer creates scenario, others (actors & directors) have to train the characters to behave properly
– Other people watch behaviors (at OSCARS), judge them (eg: realism, appropriate dialogue, …)
– Highly popular behaviors & personalities appear in the world “Hall of Fame”
• Characters can have own homes which show best behaviors
• Artists can have own exhibitions in world spaces / or in the spaces where characters behave
Observing Behaviors (2/2)
• Behaviors can be “sent” out of the world– Eg: on holiday cards, as “gifts” to people
• The world can be observed by probes– Newspaper reports interesting events– People can teleport (in space & time) to view the
events• Behaviors can be made into movie snippets
– For stories, machinema movies, or Flash comics– Create comics (storyboards) from snippets of
interaction
How to do this: Next Level of Detail
Say
MoveTo
PerformAnim
Say
MoveTo
PerformAnim
Say
MoveTo
PerformAnim
Max
Amanda
Mary
Expert 1
Expert 2
Expert 3
Behavior Authoring through Demonstration
• Having an Online World where you can author your characters,
• The world is inhabited by virtual characters created by humans.
Behavior Exchange/Sharing/Learning through Observation
Dating Situation
I really like you
That’s so cool. Lets meet tomorrow
That’s a nice way to propose. My own way didn’t work last time
Express Surprise
GestureSurprise
Express Love
Long Kiss
Love a PartnerBehavior
Set
Express Surprise
GestureSurprise
Express Love
Love a PartnerBehavior
Set exchange
DEMONSTRATE BEHAVIOR
1. Set up Scene 2. Demonstrate
3. Annotate
Create Script
SCENE SETUP
User can chose from existing situations (using Situation Ontology UI)
Or create a new situation
S
Creating new situation:
1. Chose objects(via Object Ontology UI)
2. Chose participants (via character list)
3. Set othersituation properties
Other complimented
me
I am happy
Hello, strong warrior.
S
DEMONSTRATE
[<<] Gestures [>>]
Express Joy
GreetShake Hand
Low-level Behaviors(eg: specific animations)
High-level Behaviors(eg: have dinner)
Express Gratitude
Current Goal(s):
I
D
ANNOTATE
1. View Timeline
A
ANNOTATE
2. Annotate Timeline (via Goal Ontology)
Expressing Happiness
MovingCloser
MovingCloser
Goal Ontology
A
ANNOTATE
3. Second layer Annotations
Goal Ontology
Happy Greeting
Joining the Dinner
A
Time
G:Surprise
Conv Turn 1
Oh! Hi Max! Long time no see
V:Surprise Greeting
Annotation Interface II
Amanda Amanda
Wow, hi Amanda. It’s certainly a surprise to see you here..
GreetingG:Surprise V:Surprise
Conv Turn 2
Goal: SurpriseGreeting
“oh!”
“what a surprise!”
<eyes widen>“really?”
v.1
Goal Ontology
V:Surprise
LongKiss
Love a Partner
G:Surprise
ExpressLove
ExpressSurprise
1. Set up Scene 2. Watch Intearction
3. Debug
WATCHING BEHAVIOR
SCENE SETUP
Goals (active & inactive)
EmotionsHappiness
Hunger
1. Chose Character(s) 2. Chose / Create Situation 3. Set Character Mental State
Hello, strong warrior.
WATCH INTERACTION
Goals
EmotionsGoals
Emotions
DEBUG INTERACTIONS
Goals
EmotionsGoals
Emotions
`
JACK DOE:
Likes:
Dislikes:
Fears:
Traits:
Irritable
Professional
Shy
people furniture
plants
Skills:
Doctor
PERSONALITY EDITOR
Express Surprise
VocalSurprise
GestureSurprise
“oh!”
“what a surprise!”
<eyes widen>“really?”
Express Love
Long KissPrivate
Conversation
Love a Partner
v.1 v.2Having Dinner
Greeting a Person
Loving
Expressive
Personality TraitsGoal Ontology
Situations
Easily Angered
• Behavior exchange provides an initial behavior set in a different situation
• Tweaked by the author according to his character personality
• Generalized Behavior created by these variations providing initial behavior library for a new character (somebody entering new)
Generalizing Scripts based on 5-6 variations of tweaked behavior set
Story Creation Tools as an after effect
• Global Situation library provides a way of creating different stories by choosing different situations that need to be ordered according to the story
• Different Characters can be used according to their personality type, ranking of how well they act out on these situations.
Situation Hierarchy/Extension1. Take a particular situation and extend it in creative
ways i.e. Tweak it in a different way…, you get more points if people tweak your situation i.e. use it as a starting point
• Change the dialogs• Change personality of the character and act
out according to the personality• Change the mood• What other ways can we change????
Verbal Behavior• Behaviors can be described at the goal layer, not necessarily
needing visual behavior
• Creation: user provides a “script” describing high level properties of a situation. (Annotation without a behavior)– Can have class of users which are Writers – demonstrate &
annotate verbally• Observation: system can generate “script” from a situation (instead
of generating low level behaviors)– System can write a chapter of a novel
• Users can request what situations to be created– System can produce “Newspaper” reports of what happens in
the game world
2D world ?• Less realism details to worry about• Easier to create
– Simplistic animations / Facial expressions can be modified by users– Objects & situations more simple to set up
• Easier to demonstrate & debug – actions more exagerated, more visible– Navigation easier, less likely to miss interaction details
• Characters more easily ported outside of world– Exportable to images for holiday cards / email attachments / fliers, Action
movies in flash comics– Possibly easier to create interfaces for this
• More accessible – no download necessary• Problem: Maybe not easy to find user-base.
• Can be 2.5D to allow depth for crowds• Can extend to 3D later (ooOH!)
Names• eHuman• ePerson• Digital Playground• GodEye/Godisus• eVitalize• Digivitalize• eClones• DigiIdentity• Lifeforge• WikiHuman