Creating Character's That Based On User Input

January 28, 2014 - 7:40pm by jkarmel

I'm working on an application where a character will talk to the user based on user input, saying back an altered version of what the user says. It looks like FaceFX makes this possible based on this demo on I found on your website: http://www.facefx.com/content/unity-text-animation-demo. However, Doug's final comment in this forum post: http://www.facefx.com/forums/creating-interactive-3d-avatar makes it seem like the FaceFX studio does not support that feature and that I would have to license it. Can someone clarify this for me?

January 28, 2014 - 10:40pm by doug

Permalink

FaceFX Studio is an offline tool. If you have a handful of responses, you could record them, create animations for them with FaceFX Studio, then use them in your application, no problem.

But you are dynamically generating new responses based on user input. So you need a server that is working like FaceFX Studio to analyze the audio and create new animations on the fly.

Currently, we have a server like that, and it is free for you to experiment with. We are looking into commercializing this server, making it more robust, and charging for its use. But right now, all we have is the free demo server.

January 28, 2014 - 11:28pm by jkarmel

Permalink

Hey Doug,

Thanks for your prompt and helpful response. Would you be open to my creating such a server and using it until you have your commercial product available? (it sounds like an amazing product by the way and I can't wait to use)

Best,
Jeremy

January 29, 2014 - 5:33pm by doug

Permalink

You can't make a server with FaceFX Studio Professional. The only way to trigger a new analysis is by interacting with the mouse.

January 29, 2014 - 8:40pm by jkarmel

Permalink

You're right that it would be very tricky to create something like that and it also sounds like that's not what you intended and is probably rightly against your terms of service. That makes sense.

I have a use case for this that I'm really excited about. You mentioned in your original blog post (http://www.facefx.com/content/unity-text-animation-demo) to email you guys if someone had the need for a production server. I'm going to send you an email separately about this. Thanks for your wonderful help on this forum and for your awesome product!