An open-source project developed with Unity3D and Photon to create a collaborative 3D virtual environment for academic and educational purposes.
Now powered by AI!
SENEM-AI is a learning virtual environment for lecturers and studeents. To learn more about the SENEM project, check our paper.
- Room system: Real-time connection with other users, by creating or joining rooms.
- 3D exploration: Navigate the classroom freely, interact with objects, walk, sit, rotate view, and adjust zoom.
- Avatar customization: Personalize appearance, including skin, uniform, eyes, eyebrows, hair, beard, glasses, and other cosmetics.
- Voice chat: Realistic communication with proximity and 3D audio effects.
- Text chat: Integrated text communication available in the interface.
- Non-verbal actions: Perform animations like waving, clapping, or raising hands.
- Multimedia projection: Upload and display slides/images via a projector; control content with a presenter role.
- Whiteboard interaction: Type and write on a shared whiteboard; visible to all participants, with one user at a time writing.
SENEM now features Smart Students, powered by LLMs! These AI-driven avatars simulate realistic student behaviors to help presenters and lecturers to train their presentation and question answering skills! Choose a topic lesson and the number of students you want, and you will find thm in your virtual classroom. To make them work in SENEM, you will need to get the Smart Student Server.
- Different personalities, voices, and appearances: Each Smart Student features unique appearances, personality parameters that shape their interaction style, and randomized voices to simulate a diverse classroom audience.
- Vocal and textual interaction: They communicate through a voice synthesizer and actively participate in the text chat by asking or answering questions.
- Make and answer questions: Smart Students can engage dynamically by responding to your questions or posing their own as the lesson unfolds.
This repository contains:
- Metaverse_Classroom_2: The complete Unity Project of the application.
- Windows Build: The built application ready to use for Windows.
- MacOS Build.app: The built application for MacOS.
You can either use a pre-built version of the application or access the entire project in Unity. In either case, if you want to try out the Smart Students functionality you will need the corresponding server and follow the instructions there for installation.
Windows:
- Download the Windows Build folder.
- Run the SENEM_AI executable.
MacOS:
-
Download and Extract
- Download the file
_MacOS Build.app_and extract it into a folder.
- Download the file
-
Allow Your Device to Run the Application
Follow these steps to grant the necessary permissions:- Open the Terminal and navigate to the folder containing the extracted files.
- Run the following commands in the Terminal:
chmod -R +x "MacOS Build.app/Contents/MacOS" xattr -cr "MacOS Build.app"
- Double-click on
_MacOS Build.app_to launch the application.
Requirements:
- Unity3D version: 2021.3.22f1
- Unity Hub
- Smart Student Server (optional, runs locally)
Steps:
- Download Metaverse_Classroom_2.
- Open the Unity Hub, go in the Projects tab and click on the Add button.
- Choose the path where you downloaded the Metaverse_Classroom_2.
- The project should now appear in your projects list. Click on its name and Unity will install all the needed libraries to make it work.
- [Optional] Clone the Smart Students Server repository and follow the instructions to install it.
Have fun with SENEM-AI!