From e09fb3d550dcc45c29540d07cabe680b0ddc9c54 Mon Sep 17 00:00:00 2001 From: CowwanVT <159077207+CowwanVT@users.noreply.github.com> Date: Mon, 5 Feb 2024 20:48:44 -0500 Subject: [PATCH] Update README.md a --- README.md | 46 +++++++++++++++++++++++----------------------- 1 file changed, 23 insertions(+), 23 deletions(-) diff --git a/README.md b/README.md index d244e48..22932dc 100644 --- a/README.md +++ b/README.md @@ -31,33 +31,33 @@ onnxruntime I tried to make this nice but indents don't exist here I guess
-Major restructure
-I've broken out major chunks of functionality into separate files to make them easier to deal with and read
- -I've tried to break functions down into multiple smaller parts when possible
- -I've taken a more object oriented approach in some places
- -I've removed features that didn't fit my needs
- -Removed functionlaity for tracking multiple faces
- -Removed options I didn't forsee myself using (this was intended to be just for me)
+---I've tried to break functions down into multiple smaller parts when possible
+---I've taken a more object oriented approach in some places
+---I've removed features that didn't fit my needs
+---Removed functionlaity for tracking multiple faces
+---Removed options I didn't forsee myself using (this was intended to be just for me)
-Added more threading and multi-processing
- -The webcam (and some new image processing) are now on a separate process
- -Previews are now a separate process because I didn't want to deal with the related performance weirdness
- -Console messages are now handled via a helper thread, idk if it does any good, but it can't hurt
- -VTS communication is also handled via a helper thread
+---The webcam (and some new image processing) are now on a separate process
+---Previews are now a separate process because I didn't want to deal with the related performance weirdness
+---Console messages are now handled via a helper thread, idk if it does any good, but it can't hurt
+-V--TS communication is also handled via a helper thread
-Added image pre-processing
- -I'm now applying a gamma curve to the webcam output to make faces more visible
- -The gamma curve is calculated after face tracking is done, it uses a copy of the webcam frame and face location data so get the average brightness of the face
- -This has drasitcally improved low light performance
- -It also lets me run the webcam with no gain
- -Removed the separate library that handled the webcam, then broke that off into a separate library again
- -The stuff around the webcam is still simpler now, most of the existing cases didn't apply to my use case
+---I'm now applying a gamma curve to the webcam output to make faces more visible
+---The gamma curve is calculated after face tracking is done, it uses a copy of the webcam frame and face location data so get the average brightness of the face
+---This has drasitcally improved low light performance
+---It also lets me run the webcam with no gain
+---Removed the separate library that handled the webcam, then broke that off into a separate library again
+---The stuff around the webcam is still simpler now, most of the existing cases didn't apply to my use case
-Revamped the way features are calculated and normalized
- -This was kind of my original intent, my eyes kept registering as closed when they were not
- -Removed features that didn't seem to be used by Vtube Studio
- -Added functionality to apply response curves to features
- -Removed the calibration period in favor of a system where the limits of features slowly decay towards a center point
- -Removed the average from the way featured are normalized
+---This was kind of my original intent, my eyes kept registering as closed when they were not
+---Removed features that didn't seem to be used by Vtube Studio
+---Added functionality to apply response curves to features
+---Removed the calibration period in favor of a system where the limits of features slowly decay towards a center point
+---Removed the average from the way featured are normalized
-Added a feature to prevent errant eye movements
- -Each eye has an average confidence and standard deviation calculated every frame
- -eye movements more than two standard deviations below average are severely restricted
- -The restriction is based on how far the confidence is from the cutoff poin
t +---Each eye has an average confidence and standard deviation calculated every frame
+---eye movements more than two standard deviations below average are severely restricted
+---The restriction is based on how far the confidence is from the cutoff poin
t -Added early exits to situations where subsequent steps will fail
-The main process skips frames when the webcam falls behind, once webcam latency is long enough to be late it will remain behind otherwise
-Added warnings to various states such as late webcam frames, longer than ideal frames, and early exits