Visage Technologies Documentation

Page tree

Versions Compared

Old Version 18

changes.mady.by.user Admin

Saved on

compared with

New Version 19

changes.mady.by.user Admin

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Expand
titleNew face detection model

Introducing a more accurate and robust face detection model. The new model is used in face tracking and face detection when use_vnn configuration parameter is set to 1. Otherwise, the previous face detection model will be used.

Info

For more information about using VNN detection algorithm, please consult VisageTracker Configuration Manual, paragraph 2.1.Configuration parameters and VisageFeaturesDetector documentation.


...

Expand
titleVisageFaceRecognition

Added support for multiple image format for extractDescriptor() and addDescriptor()methods.

extractDescriptor()

In addition to RGB and grayscale, now accepts RGBA input image

addDescriptor()

In addition to RGB, now accepts RGBA and grayscale input image


Changes in configuration file

Expand
titleuse_vnn parameter change

use_vnn configuration parameter added to VisageFeaturesDetector configuration file FaceDetector.cfg(located in Samples/data/bdstdata) and set to value 1.

Info

VNN algorithm will be used in VisageFeaturesDetector API by default.

use_vnn configuration parameter values changed and additional value added:

Parameter value

Effect

0

VNN algorithm is disabled, default tracking algorithm and detection model are used

1

VNN algorithm enabled in fast mode, at the cost of feature points precision

2

VNN algorithm enabled, improved precision, accuracy and robustness


Info

For detailed description of these changes, consult VisageTracker Configuration Manual, paragraph 2.1.Configuration parameters.

VisageTracker Configuration Manual

If you want to update your existing configuration files, it is recommended to copy the parameters values from Facial Features Tracker - Ultra.cfg configuration file supplied in this package.


...

Expand
titleData files modification

As a consequence of improving algorithms, removing in-house developed runner, and improving VNN algorithm, there are certain changes in the data files.

API

Status

Location

Files/Folders

VisageFaceRecognition

Status
colourRed
titleremoved

bdtsdata/NN/

fr.bin

VisageFaceAnalyser

Status
colourRed
titleremoved

bdtsdata/LBF/vfadata/ad/

ae.bin

VisageTracker
VisageFeaturesDetector

Status
colourRed
titleremoved

bdtsdata/NN/

pr.bin, model.bin

VisageFaceRecognition

Status
colourPurple
titleADDED

bdtsdata/FF/vnn/

fr.vino.bin, fr.vino.xml

VisageTracker
VisageFeaturesDetector

Status
colourPurple
titleADDED

bdtsdata/FF/vnn/

ff.vino.bin, ff.vino.xml

VisageTracker
VisageFeaturesDetector

Status
colourYellow
titleMODIFIED

bdtsdata/NN/vnn

bdtsdata/NN/vnn


Info

Projects using older versions of these files should be updated to contain the newest data files from the bdtsdata folder.


...

Expand
titleConfigurable tracking algorithm

New experimental algorithm for face tracking and alignment introduced - VNN algorithm.

For the price of slightly reduced tracking speed/performance, it significantly improves tracking quality and robustness. VisageTracker and VisageFeaturesDetector can be configured to use VNN algorithm via configuration parameter - use_vnn.

Info

For more information on use_vnn parameter, please consult VisageTracker Configuration Manual, paragraph 2.1.Configuration parameters and VisageTracker class documentation.


Tip

It is recommended to use VNN algorithm with OpenVINO™ toolkit which significantly improves the speed of running neural networks, thus mitigating any performance reductions.

OpenVINO is a trademark of Intel Corporation or its subsidiaries.


...

Expand
titleVisageConfiguration API

Introducing new C++ and C# API for programmatically changing VisageTracker configuration parameters, including new additional classes and templates:

VisageConfiguration

Modify configuration parameters on the fly

VsCfgArr

Helper template structure for storing various VisageConfiguration array data types

The aforementioned classes are used in conjunction with new VisageTracker methods:

C++

VisageConfiguration VisageTracker::getTrackerConfiguration()

void VisageTracker::setTrackerConfiguration(VisageConfiguration &configuration)

C#

VisageConfiguration VisageCSWrapper.VisageTracker.GetTrackerConfiguration()

void VisageCSWrapper.VisageTracker.SetTrackerConfiguration(VisageConfiguration configuration)


Note

There are slight differences in usage between C++ and C#. For example, C++ API uses helper structure VsCfgArr to return specific data types where C# uses native C# types.


Info

VisageConfiguration and VsCfgArr class documentation contains more details and examples of usage in code.


...

Expand
titleDeprecation notice

VisageTracker method stop has been deprecated from both APIs.

C++

VisageTracker::stop()

C#

VisageCSWrapper.VisageTracker.Stop()



Expand
titleLicensing

Prototype of method

void initializeLicenseManager(const char *licenseKeyFileName)

changed to

int initializeLicenseManager(const char *licenseKeyFileName)

Info

It is no longer necessary to declare the licensing function prototype explicitly within your code. Including any of the following headers will also include the licensing prototype:

  • VisageTracker.h

  • VisageFeaturesDetector.h

  • VisageFaceRecognition.h

  • VisageFaceAnalyser.h


...

Expand
titleC# API

FeaturePoint class and FDP class have additional property and functions, respectively to conform with the C++ API.

FeaturePoint

FeaturePoint.detected

FDP

bool FDP::FPIsDetected(int group, int n)
bool FDP::FPIsDetected(String name)


Info

1 indicates that the feature point is obtained from a 2D image using the tracking algorithm. 0 indicates that the feature point is estimated from fitting a 3D model onto the detected feature points of the face.


...

Expand
titleNew configuration files

Two additional configuration files have been added. One for the ear tracking feature and one for the novel tracking algorithm.

Configuration name

Parameter changed/added

Parameter value

Facial Features Tracker - High - With Ears.cfg

efine_ears
*_fitting_model
*_fitting_fdp

1
jk_300_wEars.wfm
jk_300_wEars.fdp

Facial Features Tracker - Ultra.cfg

use_vnn

1


Info

For detailed description of these changes consult VisageTracker Configuration Manual, paragraph 1.1.Standard configuration files

If you want to update your existing configuration files, it is recommended to copy the parameters values from Facial Features Tracker - Ultra.cfg configuration file supplied in this package.


...

Expand
titleNew configuration parameter - refine_ears and use_vnn

  • refine_ears parameter added, off (0) by default. Toggles the tracking and refinement of ear points (group 10) for VisageTracker and VisageFeaturesDetector.

Info

Used together with ears 3D model - jk_300_wEars.wfm

  • use_vnn parameter added, off (0) by default. Toggles usage of the new experimental algorithm for face tracking and alignment - VNN algorithm

Info

For detailed description of these changes, consult VisageTracker Configuration Manual, paragraph 2.1.Configuration parameters.


Tip

If you want to update your existing configuration files, it is recommended to copy the parameters values from Facial Features Tracker - High.cfg configuration file supplied in this package.


...

Expand
titleEar tracking 3D model

A new model file has been added for ear tracking functionality - jk_300_wEars.wfm. The model contains an additional 334 polygons and its vertices are mapped to 14 new FDP points in group 10 (10.11 - 10.24).

Info

For detailed description of these changes, consult VisageTracker Configuration Manual, paragraph 2.3.The 3D models used in tracking


...

Expand
titleEar tracking models and data

New data files and model files for ear tracking added

Location

Files

Samples/data/bdtsdata/NN

efa.lbf
efc.lbf

Samples/data/

jk_300_wEars.wfm
jk_300_wEars.fdp



Expand
titleVNN algorithm data files

New data folder and data files added for VNN algorithm in Samples/data/bdtsdata/NN/vnn

Tip

Projects using older versions of these files should be updated to contain the newest data files from the bdtsdata folder.


...

Expand
titleSmoothing factors values and range

  • smoothing_factors parameter
    Due to the re-implementation of the smoothing algorithm in VisageTracker, default values and optimal ranges for this parameter have been changed in all configurations.

Info

Please consult VisageTracker Configuration Manual, paragraph 2.1.Configuration parameters for additional information.


Tip

If you want to update your existing configuration files, it is recommended to copy the parameters values from Facial Features Tracker - High.cfg configuration file supplied in this package.


...