Commit graph

50 commits

Author SHA1 Message Date
Emiliana
eb61c6950c Added sensitivity for simple expression detection mode. 2020-08-21 16:40:19 +02:00
Emiliana
2b2acccf41 Added heuristics based simple expression detection for fun, angry and surprise. 2020-08-21 16:29:41 +02:00
Emiliana
15590e2ad7 Switched camera reading from escapi to libdshowcapture. 2020-08-06 17:59:34 +02:00
Emiliana
d489ed7d2d Added a field for additional commandline options without quotion to OpenSeeLauncher. 2020-07-26 12:17:39 +02:00
Emiliana
e8e40ef63d Added an option to completely disable position outlier caused recalibration. 2020-07-25 18:14:30 +02:00
Emiliana
1b1c6a179f Disabled automatic recalibration keeping offsets in OpenSeeIKTarget. 2020-07-25 18:12:06 +02:00
Emiliana
9bb13a1e69 Added direct support for switching off escapi in OpenSeeLauncher 2020-07-09 17:12:43 +02:00
Emiliana
ae08daa4ce Removed left over debug output in OpenSeeIKTarget 2020-07-02 16:53:08 +02:00
Emiliana
a8614fef15 OpenSeeLauncher no longer checks the provided model directory to allow paths relative to tracker executable. 2020-07-02 15:44:23 +02:00
Emiliana
892ba54ba8 When recalibrating OpenSeeIKTarget due to a position outlier, keep the IK target's position and rotation as is instead of resetting it. 2020-06-30 16:01:05 +02:00
Emiliana
5480966ef0 OpenSeeIKTarget is now more robust against tracking errors that occur while the camera is still starting up. 2020-06-21 13:11:53 +02:00
Emiliana
09f75c450b This fixes a memory leak in OpenSeeShowPoints. 2020-06-17 22:18:53 +02:00
Emiliana
d3d461bc3e The OpenSeeIKTarget can now skip tracking frames with sudden rotation changes. 2020-05-20 17:28:00 +02:00
Emiliana
8145e4b0ac The model definitions are now updated to match the currently used models as mentioned in issue #1 2020-04-30 15:39:58 +02:00
Emiliana
b43f281ef9 The OpenSeeShowPoints component can now draw lines between points to better visualize the shape of the face. 2020-04-05 15:03:52 +02:00
Emiliana
cf49ba5468 Unity components that rely on 3D points now ignore tracking data for frames with high 3D fitting error. 2020-03-30 16:44:33 +02:00
Emiliana
b6fc931723 To make the IK target's calibration easily callable from a button, it now has a Calibrate method.
Thanks to Deat for noting that this would be useful!
2020-03-28 18:13:35 +01:00
Emiliana
31536929f7 These changes further improve point normalization to make it easier to detect expressions under rotations. 2020-03-08 18:05:12 +01:00
Emiliana
9c12d29399 The OpenSeeVRMDriver example now supports tracking mouth shapes and blinks from camera information. 2020-03-08 13:50:53 +01:00
Emiliana
d678f81bda run.bat can be used to run the face tracker visualization in a slightly user friendly way. 2020-03-07 20:07:08 +01:00
Emiliana
9aeb4fe95d It is now possible to make certain expressions more important when training SVM models. 2020-03-07 13:35:58 +01:00
Emiliana
a8648eeb80 Some small fixes. 2020-03-01 19:26:45 +01:00
Emiliana
5059ef9cbf The overriding of point selection from models is now disabled. 2020-03-01 14:40:30 +01:00
Emiliana
04d7f5b8b3 This adds manually designed features to the OpenSeeData. 2020-03-01 14:23:56 +01:00
Emiliana
7706372a7a This fixes exceptions with network tracking. 2020-02-28 20:34:39 +01:00
Emiliana
04e19c9798 This adds optimizations and safety checks to the 3D point adjustments and adds an option to the IK target, which allows its position to slowly drift back to neutral. 2020-02-28 20:19:03 +01:00
Emiliana
4a88c57be2 This fixes some bugs. 2020-02-27 00:38:46 +01:00
Emiliana
0332f9cb93 This adds the gaze tracker. 2020-02-24 00:44:17 +01:00
Emiliana
6c7392b037 Learning expression actually should not depend on the location of the head. This fixes that issue. 2020-02-21 01:05:41 +01:00
Emiliana
7de50b2e25 When using OpenSeeLauncher with pinvoke, it will now log process output to log files. 2020-02-17 20:17:34 +01:00
Emiliana
e157e9d5c9 Process.Start is not supported in IL2CPP builds, so now OpenSeeLauncher has an option to do the process launching directly through DLL calls. 2020-02-17 00:25:25 +01:00
Emiliana
633293eb52 The face tracker can now offset face ids by a given value. This makes it possible to easily mix tracking input from multiple network sources. 2020-02-16 15:58:47 +01:00
Emiliana
c2eb544096 The UDP socket is now actually closed when the OpenSee component is destroyed. 2020-02-16 01:46:35 +01:00
Emiliana
2c08712aef The OpenSeeVRMDriver example uses OVRLipSync to do lip syncing from audio and apply it to a VRM avatar, while also handling expressions detected using OpenSeeExpression and applying eye blinks. 2020-02-15 13:21:46 +01:00
Emiliana
bb845098ca It is now possible to train expression models with probability support. This however is a lot slower! Also, the C parameter for SVM training was set incorrectly. Now training works much better. 2020-02-13 22:24:41 +01:00
Emiliana
9abc3029e7 OpenSeeExpression now supports detecting expressions on point subsets. 2020-02-13 21:15:19 +01:00
Emiliana
de16fc9ff9 The IK target component can now mirror the pose, which can be convenient. 2020-02-13 20:18:05 +01:00
Emiliana
1f3bf30166 There's now an example on how to apply detected expressions to a VRM model. 2020-02-11 09:55:31 +01:00
Emiliana
443a7ee88e The number of samples for expression learning is now 1000 per expression, because gathering the maximum number of samples is no longer enforced. 2020-02-10 21:46:01 +01:00
Emiliana
b5218a1eb0 Training with less data is now possible too. 2020-02-09 18:09:09 +01:00
Emiliana
b5706183c2 Incomplete expressions are now skipped. 2020-02-09 15:00:26 +01:00
Emiliana
750f9920e5 OpenSeeIKTarget is now has tooltips and can interpolate between frames, making motion much smoother. Another coordinate issue was fixed too. OpenSeeExpression can now record additional calibration data for fully recorded expressions. 2020-02-09 14:34:50 +01:00
Emiliana
0d0a30dedb This fixes a whole bunch of coordinate and rotation issues. 2020-02-09 01:25:55 +01:00
Emiliana
f8b26af1af Switching to Quaternions and converting those instead of Euler angles seems to work. 2020-02-09 00:33:08 +01:00
Emiliana
0e38bb035f For putting on a clone of the head bone and using it as an IK target in VRIK. 2020-02-08 23:41:56 +01:00
Emiliana
3a83d96827 New expression detection code 2020-02-08 21:08:21 +01:00
Emiliana
0a1bedb352 The face tracker now keeps track of which face is which. This makes 3D point estimation for multi face scenarios both more stable and faster. 2020-02-07 00:55:29 +01:00
Emiliana
dda7dd0519 All models were retrained to fix bugs in the training process. There are also other bug fixes and improvements. 2020-01-26 11:47:07 +01:00
Emiliana
9f256eab75 Blink detection and stabilized 3D pose estimation 2020-01-03 16:40:45 +01:00
Emiliana
114ab8d44e First version. 2020-01-02 12:24:25 +01:00