Emiliana
|
f25f27f1c4
|
The hotkeys weren't actually global, but now they should be.
|
2020-03-01 20:38:47 +01:00 |
|
Emiliana
|
b871090998
|
OpenSeeVRMDriver now can use global hotkeys (Ctrl+Shift+F1 to F6) to override expressions.
|
2020-03-01 19:29:17 +01:00 |
|
Emiliana
|
a8648eeb80
|
Some small fixes.
|
2020-03-01 19:26:45 +01:00 |
|
Emiliana
|
5059ef9cbf
|
The overriding of point selection from models is now disabled.
|
2020-03-01 14:40:30 +01:00 |
|
Emiliana
|
04d7f5b8b3
|
This adds manually designed features to the OpenSeeData.
|
2020-03-01 14:23:56 +01:00 |
|
Emiliana
|
7706372a7a
|
This fixes exceptions with network tracking.
|
2020-02-28 20:34:39 +01:00 |
|
Emiliana
|
04e19c9798
|
This adds optimizations and safety checks to the 3D point adjustments and adds an option to the IK target, which allows its position to slowly drift back to neutral.
|
2020-02-28 20:19:03 +01:00 |
|
Emiliana
|
033a48b132
|
This changes the points used for PnP solving and replaces the RetinaFace model with a higher resolution version.
|
2020-02-28 02:10:23 +01:00 |
|
Emiliana
|
4a88c57be2
|
This fixes some bugs.
|
2020-02-27 00:38:46 +01:00 |
|
Emiliana
|
cd9cfd9ee8
|
RetinaFace was added as a face detection scheme.
|
2020-02-26 00:54:32 +01:00 |
|
Emiliana
|
90c7c9284b
|
The datasets used for training the new gaze tracker are now mentioned in the README file.
|
2020-02-24 23:31:35 +01:00 |
|
Emiliana
|
44060dfff2
|
The eye tracking model was switched out. This one seems to be more stable.
|
2020-02-24 21:51:54 +01:00 |
|
Emiliana
|
e1a3b69d22
|
Some bugs in the gaze applier were fixed.
|
2020-02-24 01:22:23 +01:00 |
|
Emiliana
|
0332f9cb93
|
This adds the gaze tracker.
|
2020-02-24 00:44:17 +01:00 |
|
Emiliana
|
2d35cc2aaf
|
OpenSeeVRMDriver can now also apply blinks from face tracking instead of blinking automatically.
|
2020-02-21 18:52:11 +01:00 |
|
Emiliana
|
6c7392b037
|
Learning expression actually should not depend on the location of the head. This fixes that issue.
|
2020-02-21 01:05:41 +01:00 |
|
Emiliana
|
e60b9b37bd
|
The internal face 3D model will now adapt to the tracked landmarks.
|
2020-02-20 21:33:00 +01:00 |
|
Emiliana
|
7de50b2e25
|
When using OpenSeeLauncher with pinvoke, it will now log process output to log files.
|
2020-02-17 20:17:34 +01:00 |
|
Emiliana
|
e157e9d5c9
|
Process.Start is not supported in IL2CPP builds, so now OpenSeeLauncher has an option to do the process launching directly through DLL calls.
|
2020-02-17 00:25:25 +01:00 |
|
Emiliana
|
633293eb52
|
The face tracker can now offset face ids by a given value. This makes it possible to easily mix tracking input from multiple network sources.
|
2020-02-16 15:58:47 +01:00 |
|
Emiliana
|
c2eb544096
|
The UDP socket is now actually closed when the OpenSee component is destroyed.
|
2020-02-16 01:46:35 +01:00 |
|
Emiliana
|
05a9be7b71
|
Mono and stereo audio should now both be handled correctly for lip sync. More than 2 channels are not supported.
|
2020-02-15 14:58:22 +01:00 |
|
Emiliana
|
200b182ab9
|
Switching back from canned audio to microphone for lip sync in OpenSeeVRMDriver didn't work. This fixes that.
|
2020-02-15 13:44:54 +01:00 |
|
Emiliana
|
626ce2a1ae
|
Two flags were added to OpenSeeVRMDriver to allow reinitialization of different parts.
|
2020-02-15 13:35:10 +01:00 |
|
Emiliana
|
2c08712aef
|
The OpenSeeVRMDriver example uses OVRLipSync to do lip syncing from audio and apply it to a VRM avatar, while also handling expressions detected using OpenSeeExpression and applying eye blinks.
|
2020-02-15 13:21:46 +01:00 |
|
Emiliana
|
bb845098ca
|
It is now possible to train expression models with probability support. This however is a lot slower! Also, the C parameter for SVM training was set incorrectly. Now training works much better.
|
2020-02-13 22:24:41 +01:00 |
|
Emiliana
|
9abc3029e7
|
OpenSeeExpression now supports detecting expressions on point subsets.
|
2020-02-13 21:15:19 +01:00 |
|
Emiliana
|
de16fc9ff9
|
The IK target component can now mirror the pose, which can be convenient.
|
2020-02-13 20:18:05 +01:00 |
|
Emiliana
|
1f3bf30166
|
There's now an example on how to apply detected expressions to a VRM model.
|
2020-02-11 09:55:31 +01:00 |
|
Emiliana
|
443a7ee88e
|
The number of samples for expression learning is now 1000 per expression, because gathering the maximum number of samples is no longer enforced.
|
2020-02-10 21:46:01 +01:00 |
|
Emiliana
|
e83e965290
|
Reading from standard input should now work correctly.
|
2020-02-10 20:26:46 +01:00 |
|
Emiliana
|
b5218a1eb0
|
Training with less data is now possible too.
|
2020-02-09 18:09:09 +01:00 |
|
Emiliana
|
b5706183c2
|
Incomplete expressions are now skipped.
|
2020-02-09 15:00:26 +01:00 |
|
Emiliana
|
750f9920e5
|
OpenSeeIKTarget is now has tooltips and can interpolate between frames, making motion much smoother. Another coordinate issue was fixed too. OpenSeeExpression can now record additional calibration data for fully recorded expressions.
|
2020-02-09 14:34:50 +01:00 |
|
Emiliana
|
0d0a30dedb
|
This fixes a whole bunch of coordinate and rotation issues.
|
2020-02-09 01:25:55 +01:00 |
|
Emiliana
|
f8b26af1af
|
Switching to Quaternions and converting those instead of Euler angles seems to work.
|
2020-02-09 00:33:08 +01:00 |
|
Emiliana
|
0e38bb035f
|
For putting on a clone of the head bone and using it as an IK target in VRIK.
|
2020-02-08 23:41:56 +01:00 |
|
Emiliana
|
4fa2471b9c
|
Information about the expression detection component
|
2020-02-08 21:34:36 +01:00 |
|
Emiliana
|
3a83d96827
|
New expression detection code
|
2020-02-08 21:08:21 +01:00 |
|
Emiliana
|
83e400a1d1
|
Face ids can now be displayed.
|
2020-02-08 00:13:28 +01:00 |
|
Emiliana
|
7998bf715c
|
The code is now refactored to use the new FaceInfo class instead of passing around big tuples. Keeping track of which face is which is more reliable now too.
|
2020-02-07 20:59:46 +01:00 |
|
Emiliana
|
0a1bedb352
|
The face tracker now keeps track of which face is which. This makes 3D point estimation for multi face scenarios both more stable and faster.
|
2020-02-07 00:55:29 +01:00 |
|
Emiliana
|
423b5c6c86
|
The model selection parameter should now be easier to understand and two less useful models have been removed to save space. Width, height and FPS are now written to log file and both width and height are also transmitted over the network. The video output function has been changed to use a lossless codec, but videos need to be converted to a more common format before importing them to Vegas now.
|
2020-02-07 00:09:48 +01:00 |
|
Emiliana
|
18623a325f
|
These MobileNetV3 based models can be used by swapping them out for any of the two regular ShuffleNetV2 based models. They are not compatible with the smaller, faster ShuffleNetV2 model.
|
2020-02-06 23:43:49 +01:00 |
|
Emiliana
|
dda7dd0519
|
All models were retrained to fix bugs in the training process. There are also other bug fixes and improvements.
|
2020-01-26 11:47:07 +01:00 |
|
Emiliana
|
2595fa31a9
|
Information about eye blink detection
|
2020-01-03 17:08:12 +01:00 |
|
Emiliana
|
abbba992a2
|
Merge branch 'master' of github.com:emilianavt/OpenSeeFace
|
2020-01-03 16:41:07 +01:00 |
|
Emiliana
|
9f256eab75
|
Blink detection and stabilized 3D pose estimation
|
2020-01-03 16:40:45 +01:00 |
|
Emiliana
|
ca47b2e3c3
|
Information about the OpenSeeLauncher API
|
2020-01-02 14:47:51 +01:00 |
|
Emiliana
|
114ab8d44e
|
First version.
|
2020-01-02 12:24:25 +01:00 |
|