-
Notifications
You must be signed in to change notification settings - Fork 15
Home
VIDEO EXAMPLE OF GRETA FUNCTIONALITIES!
Greta is a real-time three dimensional embodied conversational agent with a 3D model of a woman compliant with MPEG-4 animation standard. It is able to communicate using a rich palette of verbal and nonverbal behaviours. Greta can talk and simultaneously show facial expressions, gestures, gaze, and head movements.
Two standard XML languages FML and BML allows the user to define her communicative intentions and behaviours based on standard SAIBA architecture.
Greta can be used with different external TTS softwares. Currently she can speak various languages: English, Italian, French, German, Swedish and Polish.
Greta is used in various European projects: ANIMATAS, ARIA-VALUSPA, Council-of-Coaches, ILHAIRE, REVERIE, SSPNet, TARDIS, VERVE, and national French projects: A1:1, Acorformed, Anipev, CECIL,IMMEMO, GV-LEX, Impressions, MOCA, Social-touch, TAPAS (French/English, Japanese). It is integrated in several open-source architectures for human-agent interaction: ARIA-VALUSPA/AVP Aria-Valuspa, SEMAINE, Agents United Plateform, and lately in IAVA.
You can find the installer of the public version of Greta System (Psyclone version), the installer of the ActiveMQ version for the SEMAINE project and some demo videos.
The wiki is structured in order to give you enough knowledge to use the Greta platform. As you can see in the sidebar at right the wiki is divided in 2 areas:
- Getting started with Greta: here you will find tutorials about how install the platform and getting start with it. It will give you a guide in the installation's steps and also examples to how use the platform, generate gestures, facial expressions, hand shapes and instances for interacion;
- Functionalities: in this section you will have more details about the modules of the platform, what are thier functionalities and how to use them;
- master: is the main version, under GPL licence since September 2024, that contains all the latest modifications (Download this);
- master-lgpl: is the LGPL version, the previous master branch before September 2024. Some of the latest functionalities might not be included.
Port | Connection (left: server, right: client) | Comment |
---|---|---|
1234 | LM-studio - Mistral.py | when you run LLM locally |
3150 | meaning_miner_adapter_server.py - meaning_miner_adapter_client.py | MeaningMiner |
4000 | Mistral.java - Mistral.py | Mistral LLM |
4040 | DeepGramFrame.java - DeepGram.py | DeepGram ASR |
4444 | ASAPFrame.java -[actual].py | ASAP |
5000 | OpenFaceOfflineZeroMQ.exe - any | TurnManagement, feedback |
5960 | turnManagement.java - turnManager.py | TurnManagement, feedback |
5961 | turnManagement.java - turnManager.py | TurnManagement, turnManagement |
8087 | SpeechRecognizerFrame.java - nothing | GoogleASR receiver |
8088 | SpeechRecognizerFrame.java - nothing | GoogleASR receiver |
9000 | mic_server.py - any | Microphone |
50150 | OpenFaceOfflineZeroMQ.java- RealTimePipeFinal.py | MODIFF-MI |
50151 | RealTimePipeFinal.py - ASAPFrame.java | MODIFF-MI |
50167 | MICounserlorIncrementalDA - Drinking.py - RealTimePipeFinal.py | MODIFF-MI |
50168 | MICounserlorIncrementalDA - Drinking.py - RealTimePipeFinal.py | MODIFF-MI |
50200 | “MICounserlorIncrementalDA - Drinking.py” - any | MI |
61616 | Broker.java - any | ActiveMQ |
- MODIFF-MI: adaptive facial expression
- MI: motivational interview
- MM: meaning miner
Advanced
- Generating New Facial expressions
- Generating New Gestures
- Generating new Hand configurations
- Torso Editor Interface
- Creating an Instance for Interaction
- Create a new virtual character
- Creating a Greta Module in Java
- Modular Application
- Basic Configuration
- Signal
- Feedbacks
- From text to FML
- Expressivity Parameters
- Text-to-speech, TTS
-
AUs from external sources
-
Large language model (LLM)
-
Automatic speech recognition (ASR)
-
Extentions
-
Integration examples
Nothing to show here