Commit graph

285 commits

Author SHA1 Message Date
Emiliana
a3a45a8e89 The captions were missing on results pictures 2020-05-21 18:19:12 +02:00
Emiliana
013deaa24e Sample images with face detection and landmark results 2020-05-21 18:13:44 +02:00
Emiliana
76b621a82a Merge branch 'master' of github.com:emilianavt/OpenSeeFace 2020-05-20 17:28:17 +02:00
Emiliana
d3d461bc3e The OpenSeeIKTarget can now skip tracking frames with sudden rotation changes. 2020-05-20 17:28:00 +02:00
Emiliana
95763bfeaa
Update README.md 2020-05-20 02:08:29 +02:00
Emiliana
0756568df1 The expression toggle hotkeys in OpenSeeVRMDriver were supposed to require both the shift and ctrl keys to be pressed, but would work with either. This fixes that. 2020-05-19 14:06:54 +02:00
Emiliana
e33e8587e0 This fixes the calculations for the smooth transitions between expressions. 2020-05-17 16:39:59 +02:00
Emiliana
f7551298af Merge branch 'master' of github.com:emilianavt/OpenSeeFace 2020-05-17 15:58:32 +02:00
Emiliana
d3a903da8e The OpenSeeVRMDriver example now supports smooth transitions between expressions. 2020-05-17 15:58:04 +02:00
Emiliana
f47e78d53e
Some outdated information was left in the README. 2020-05-01 11:56:31 +02:00
Emiliana
c9c5193a55
The dataset used to train the face detection model was missing from the README. 2020-05-01 11:48:22 +02:00
Emiliana
8145e4b0ac The model definitions are now updated to match the currently used models as mentioned in issue #1 2020-04-30 15:39:58 +02:00
Emiliana
b43f281ef9 The OpenSeeShowPoints component can now draw lines between points to better visualize the shape of the face. 2020-04-05 15:03:52 +02:00
Emiliana
cf49ba5468 Unity components that rely on 3D points now ignore tracking data for frames with high 3D fitting error. 2020-03-30 16:44:33 +02:00
Emiliana
ea735ffdde This adds a new medium quality model. Unused models were removed and the README.md file updated. 2020-03-29 15:56:54 +02:00
Emiliana
b6fc931723 To make the IK target's calibration easily callable from a button, it now has a Calibrate method.
Thanks to Deat for noting that this would be useful!
2020-03-28 18:13:35 +01:00
Emiliana
8c547a3b39 Some slight optimizations for multi face tracking. 2020-03-28 14:57:56 +01:00
Emiliana
b6554ddeaa This adds a new fastest model. 2020-03-28 13:14:50 +01:00
Emiliana
4268abb00a The basic 3D point model used for 3D point fitting is now based on data from fitting the points to head-pose-face-detection-female.mp4 over multiple iterations 2020-03-26 19:00:33 +01:00
Emiliana
60fb3aac31 Lower overlap threshold. 2020-03-25 23:02:23 +01:00
Emiliana
3f85a44f13 Slightly higher threshold. 2020-03-25 22:57:13 +01:00
Emiliana
9bd3fcc617 When multiple faces were close to each other, some of them were removed by accident. This fixes that. 2020-03-25 22:52:28 +01:00
Emiliana
5c118347b6 New and improved tracking model and confidence value visualization. 2020-03-25 17:03:30 +01:00
Emiliana
b0a61b41d5 RetinaFace inference is now done at full resolution without padding. 2020-03-22 18:01:21 +01:00
Emiliana
381d3b67ec Small bugfix. 2020-03-22 14:20:17 +01:00
Emiliana
14b4bd9122 As the Haar Cascade face detector is no longer used, it is now remoed. 2020-03-22 14:14:26 +01:00
Emiliana
c03e222a49 Smaller, faster and better detection model. 2020-03-22 13:47:55 +01:00
Emiliana
a10eacc670 A new, custom face detection model is now used to lock onto faces for tracking. 2020-03-22 00:34:34 +01:00
Emiliana
4f611997f3 Fudging thresholds when the head turns left or right is cheating, but it seems to work well. 2020-03-08 18:15:43 +01:00
Emiliana
31536929f7 These changes further improve point normalization to make it easier to detect expressions under rotations. 2020-03-08 18:05:12 +01:00
Emiliana
9c12d29399 The OpenSeeVRMDriver example now supports tracking mouth shapes and blinks from camera information. 2020-03-08 13:50:53 +01:00
Emiliana
d678f81bda run.bat can be used to run the face tracker visualization in a slightly user friendly way. 2020-03-07 20:07:08 +01:00
Emiliana
9aeb4fe95d It is now possible to make certain expressions more important when training SVM models. 2020-03-07 13:35:58 +01:00
Emiliana
94d2f4fbe0 With this, the face tracker will actually track at the specified FPS, saving CPU especially at lower tracking frame rates. 2020-03-03 18:48:52 +01:00
Emiliana
0c84f50672 3D points are now normalized by reference sizes. 2020-03-01 22:27:50 +01:00
Emiliana
f25f27f1c4 The hotkeys weren't actually global, but now they should be. 2020-03-01 20:38:47 +01:00
Emiliana
b871090998 OpenSeeVRMDriver now can use global hotkeys (Ctrl+Shift+F1 to F6) to override expressions. 2020-03-01 19:29:17 +01:00
Emiliana
a8648eeb80 Some small fixes. 2020-03-01 19:26:45 +01:00
Emiliana
5059ef9cbf The overriding of point selection from models is now disabled. 2020-03-01 14:40:30 +01:00
Emiliana
04d7f5b8b3 This adds manually designed features to the OpenSeeData. 2020-03-01 14:23:56 +01:00
Emiliana
7706372a7a This fixes exceptions with network tracking. 2020-02-28 20:34:39 +01:00
Emiliana
04e19c9798 This adds optimizations and safety checks to the 3D point adjustments and adds an option to the IK target, which allows its position to slowly drift back to neutral. 2020-02-28 20:19:03 +01:00
Emiliana
033a48b132 This changes the points used for PnP solving and replaces the RetinaFace model with a higher resolution version. 2020-02-28 02:10:23 +01:00
Emiliana
4a88c57be2 This fixes some bugs. 2020-02-27 00:38:46 +01:00
Emiliana
cd9cfd9ee8 RetinaFace was added as a face detection scheme. 2020-02-26 00:54:32 +01:00
Emiliana
90c7c9284b The datasets used for training the new gaze tracker are now mentioned in the README file. 2020-02-24 23:31:35 +01:00
Emiliana
44060dfff2 The eye tracking model was switched out. This one seems to be more stable. 2020-02-24 21:51:54 +01:00
Emiliana
e1a3b69d22 Some bugs in the gaze applier were fixed. 2020-02-24 01:22:23 +01:00
Emiliana
0332f9cb93 This adds the gaze tracker. 2020-02-24 00:44:17 +01:00
Emiliana
2d35cc2aaf OpenSeeVRMDriver can now also apply blinks from face tracking instead of blinking automatically. 2020-02-21 18:52:11 +01:00