Fork of emilianavt/OpenSeeFace (PnP translation shape fix for newer NumPy/OpenCV)
Find a file
2024-02-07 18:41:16 -05:00
.github add action to append date to artifact name during upload 2022-09-12 14:57:51 -04:00
dshowcapture added initial dshowcapture support 2024-02-07 07:45:54 -05:00
Licenses Added files to enable using EmilianaVT's parameter calculations 2024-02-06 08:26:22 -05:00
models I don't reference these models anymore 2024-02-05 17:05:35 -05:00
.gitignore changed required package name, added git ignore for virtual environment folder 2024-02-05 20:39:16 -05:00
dshowcapture.py added initial dshowcapture support 2024-02-07 07:45:54 -05:00
emilianaFeature.py Added files to enable using EmilianaVT's parameter calculations 2024-02-06 08:26:22 -05:00
emilianaFeatureExtractor.py Setup a feature to allow the use of EmilianaVT's featureExtracotor 2024-02-06 09:53:08 -05:00
eyes.py removed the message queue and thread, it was a silly idea 2024-02-06 23:37:57 -05:00
face.py Made landmarks static 2024-02-06 21:18:49 -05:00
facedetection.py removed the message queue and thread, it was a silly idea 2024-02-06 23:37:57 -05:00
facetracker.py moved visualization to the preview thread, reduced latency, added --threads functionality 2024-02-07 18:41:16 -05:00
facetracking.sh moved visualization to the preview thread, reduced latency, added --threads functionality 2024-02-07 18:41:16 -05:00
feature.py Made FeatureExtractor a separate file 2024-02-06 08:16:39 -05:00
featureExtractor.py fixed a bug that caused my eye_open to not work after making the older version work 2024-02-06 10:04:19 -05:00
landmarks.py Made landmarks static 2024-02-06 21:18:49 -05:00
LICENSE First version. 2020-01-02 12:24:25 +01:00
poetry.lock Updated poetry.lock 2024-01-25 12:33:50 +01:00
preview.py moved visualization to the preview thread, reduced latency, added --threads functionality 2024-02-07 18:41:16 -05:00
pyproject.toml add pyproject.toml and poetry.lock 2021-10-30 15:44:04 +02:00
README.md a 2024-02-05 22:01:20 -05:00
README.txt added initial dshowcapture support 2024-02-07 07:45:54 -05:00
remedian.py Added files to enable using EmilianaVT's parameter calculations 2024-02-06 08:26:22 -05:00
tracker.py moved visualization to the preview thread, reduced latency, added --threads functionality 2024-02-07 18:41:16 -05:00
vts.py removed the message queue and thread, it was a silly idea 2024-02-06 23:37:57 -05:00
webcam.py moved visualization to the preview thread, reduced latency, added --threads functionality 2024-02-07 18:41:16 -05:00

This is kind of a personal project, but it spiraled out of control and I figured I'd share it in case anyone else can make use of it.

I make no promises to the quality of this code or the reliablity of it

I am not responsible if this somehow causes you issues

I have drastically restructured this, but I'm listing it as a fork because this is still based on emilianavt's work.

I am specifically targeting Vtube Studio on Linux, some stuff was changed to make it work with VTS, idk how well it works with VeeSeeFace at this point

This is also very much tuned to how I use it and what works best for me, so I make no promises there

If you do use it, be aware that I removed directshow support(can't make use of it) and MJPEG is kinda janky, so your best bet is 480p which defaults to raw rgb

This will do a rock steady 30fps on my system as long as my cpu isn't completely overloaded

I'll update this readme to explain more later, but first I need to actually upload all my changes. I didn't expect this to turn into something I wanted to upload.

Packages you'll need

Numpy

OpenCV-python

onnxruntime

For documentation on how openseeface works and the computer vision models, go see https://github.com/emilianavt/OpenSeeFace I don't want to leave documentation here that makes it seem like this is all my work

Seriously, emilianavt did all the hard work

actual documentation is in the README.txt because working in plain text is easier than making github's markdown cooperate