Commit graph

37 commits

Author SHA1 Message Date
Emiliana
048304e509 More small fixes 2020-06-30 23:19:51 +02:00
Emiliana
bfa92c30ee This fixes various bugs and unintuitive behaviour with additive expressions. 2020-06-30 23:03:36 +02:00
Emiliana
7197b37a2a Added support for additive expressions to OpenSeeVRMDriver 2020-06-30 21:44:37 +02:00
Emiliana
4e5ab5e25c Detecting custom eyebrow blendshape clips in OpenSeeVRMDriver is now case insensitive. 2020-06-30 14:16:08 +02:00
Emiliana
829bacdba8 Added an option to disable hotkeys in OpenSeeVRMDriver 2020-06-29 20:02:55 +02:00
Emiliana
7f2a8fea5e Added GetExpression method to OpenSeeVRMDriver to retrieve configured expressions efficiently by trigger/name. 2020-06-28 20:15:00 +02:00
Emiliana
cfa999c944 Expression hotkeys are now more configurable and trigger hotkeys instead of toggle hotkeys are supported as well. 2020-06-28 14:19:11 +02:00
Emiliana
baf4d546c0 Added hybrid lip sync/mouth tracking to OpenSeeVRMDriver. 2020-06-27 13:13:45 +02:00
Emiliana
8d2df41d24 More settings for eyebrow tracking. 2020-06-26 18:11:41 +02:00
Emiliana
161363682d OpenSeeVRMDriver now supports linked eye blinking. 2020-06-21 19:02:32 +02:00
Emiliana
bed95be58c OpenSeeVRMDriver now properly resets blendshape clips each frame and correctly mixes in eyebrows for models with custom VRM blendshape clips. 2020-06-21 13:13:06 +02:00
Emiliana
80081bed1f OpenSeeVRMDriver now properly combines VRM blendshape clips for expressions and mouth animation. 2020-06-18 12:13:50 +02:00
Emiliana
7b4d3e1b11 This fixes various smoothness issues with the eyebrow tracking. 2020-06-10 20:07:40 +02:00
Emiliana
4d58c3304d VRM blendshape clips with the names "Brows up" and "Brows down" are now prioritized over auto detected blendshapes. This also fixes a bug with the interpolation code. 2020-06-08 11:58:27 +02:00
Emiliana
fe6690543e Eyebrow tracking can now be controlled on a per expression basis. 2020-06-07 18:49:10 +02:00
Emiliana
87b4079d68 This makes the eyebrowStrength parameter actually do something. 2020-06-07 17:33:56 +02:00
Emiliana
f5af947d5b There is now better smoothing for visemes and basic eyebrow tracking for VRoid and Cecil Henshin models. 2020-06-07 17:16:15 +02:00
Emiliana
b09639b71d Lip sync should now be able to handle stereo audio where one track is silent, but Unity's microphone input is forced to mono audio anyways. It still improves things with canned audio. 2020-05-22 18:51:34 +02:00
Emiliana
0756568df1 The expression toggle hotkeys in OpenSeeVRMDriver were supposed to require both the shift and ctrl keys to be pressed, but would work with either. This fixes that. 2020-05-19 14:06:54 +02:00
Emiliana
e33e8587e0 This fixes the calculations for the smooth transitions between expressions. 2020-05-17 16:39:59 +02:00
Emiliana
d3a903da8e The OpenSeeVRMDriver example now supports smooth transitions between expressions. 2020-05-17 15:58:04 +02:00
Emiliana
cf49ba5468 Unity components that rely on 3D points now ignore tracking data for frames with high 3D fitting error. 2020-03-30 16:44:33 +02:00
Emiliana
381d3b67ec Small bugfix. 2020-03-22 14:20:17 +01:00
Emiliana
4f611997f3 Fudging thresholds when the head turns left or right is cheating, but it seems to work well. 2020-03-08 18:15:43 +01:00
Emiliana
9c12d29399 The OpenSeeVRMDriver example now supports tracking mouth shapes and blinks from camera information. 2020-03-08 13:50:53 +01:00
Emiliana
d678f81bda run.bat can be used to run the face tracker visualization in a slightly user friendly way. 2020-03-07 20:07:08 +01:00
Emiliana
9aeb4fe95d It is now possible to make certain expressions more important when training SVM models. 2020-03-07 13:35:58 +01:00
Emiliana
f25f27f1c4 The hotkeys weren't actually global, but now they should be. 2020-03-01 20:38:47 +01:00
Emiliana
b871090998 OpenSeeVRMDriver now can use global hotkeys (Ctrl+Shift+F1 to F6) to override expressions. 2020-03-01 19:29:17 +01:00
Emiliana
033a48b132 This changes the points used for PnP solving and replaces the RetinaFace model with a higher resolution version. 2020-02-28 02:10:23 +01:00
Emiliana
e1a3b69d22 Some bugs in the gaze applier were fixed. 2020-02-24 01:22:23 +01:00
Emiliana
0332f9cb93 This adds the gaze tracker. 2020-02-24 00:44:17 +01:00
Emiliana
2d35cc2aaf OpenSeeVRMDriver can now also apply blinks from face tracking instead of blinking automatically. 2020-02-21 18:52:11 +01:00
Emiliana
05a9be7b71 Mono and stereo audio should now both be handled correctly for lip sync. More than 2 channels are not supported. 2020-02-15 14:58:22 +01:00
Emiliana
200b182ab9 Switching back from canned audio to microphone for lip sync in OpenSeeVRMDriver didn't work. This fixes that. 2020-02-15 13:44:54 +01:00
Emiliana
626ce2a1ae Two flags were added to OpenSeeVRMDriver to allow reinitialization of different parts. 2020-02-15 13:35:10 +01:00
Emiliana
2c08712aef The OpenSeeVRMDriver example uses OVRLipSync to do lip syncing from audio and apply it to a VRM avatar, while also handling expressions detected using OpenSeeExpression and applying eye blinks. 2020-02-15 13:21:46 +01:00