A voice chatbot that can imitate your expression.
This is a Unity project (just for Android now), which has two modules.
- One is FaceTracking, which using OpenCV and Dlib to detects facial expressions, converts them into Live2D model, and record gif.
- The other is AI
(chatbot), which uses Turing Robot, Iflytek IAT and Iflytek TTS to make a voice chat.
English | 简体中文
Google Play . Facemoji 废萌- 酷安 . Facemoji 废萌
- Github . Facemoji/releases
- Drive.Google . Facemoji/Platform
- Pan.Baidu . Facemoji/Platform
- Download
shape_predictor_68_face_landmarks.dat(Facial Landmark Detector) andFacemoji_Plugins_Assets_1.5.0.unitypackage(Streamlined OpenCV, Dlib, Live2D and Iflytek Assets Library) from Drive.Google or Pan.Baidu git clone https://github.com/huihut/Facemoji.git- Create new Unity project (called
FacemojiDemo) - Copy
Facemoji/AssetsandFacemoji/ProjectSettingsto your unity project (FacemojiDemo/) - Copy
shape_predictor_68_face_landmarks.datto yourFacemojiDemo/Assets/StreamingAssets/ - Import
Facemoji_Plugins_Assets_1.5.0.unitypackage - Select Android platform
- Build & Run
Using OpenCV and Dlib to detects facial expressions, converts them into Live2D model.
She can move with your face and you can try shaking your head.
The middle of the above is the record button, you can record 3 seconds gif.
Recorder State : Recording(Ready to record) -> PreProcessing(Is recording) -> Paused(Compressing gif) -> Recording(Ready to record)
Save the gif in Application.dataPath
(Android in /storage/emulated/0/Android/data/com.huihut.facemoji/files/)
Using Turing Robot, Iflytek IAT and Iflytek TTS.
You can chat with her by voice or text.
She's a great AI (robot), and she can:
- Chat
- Encyclopedia
- Calculate
- Tell a story
- Tell a joke
- Idiom Solitaire
- Horoscope
- Weather forecast
- ...
But because she is a Chinese robot(Turing robot only supports Chinese), she can only chat in Chinese.
She will chat in English later.
-
Come On !
-
No~ No~
-
Wink !
