Sections

Skip to content. | Skip to navigation

You are here: Home Research Tongue tracking samples

Tongue tracking samples

This page aims to give a few examples of our tongue tracking algorithm at different stages during its development.  Our most recent version is included first, immediately below, along with older versions below that (in reverse chronological order) for comparison. 

Most recent tongue tracking (version 1.0)

Loading the player ...

 

This video gives a sample of the most recent version of our tongue tracking algorithm.  The greyscale video sequence is the raw ultrasound scan data of a child saying "k... aka .. iki... oko".  The bright moving edge corresponds to the tongue surface in the midsagittal plane (with the child speaker facing to the right). The overlaid magenta contour is the result of our fully automatic tongue tracking algorithm.   Notice that the magenta contour tracks the underside of the bright moving edge (which corresponds to the tongue surface) very closely! Compare this with previous versions of our work below, which are not able to track the tongue surface as closely and accurately.

 

Development tongue tracking (version 0.5)

Loading the player ...

 

This video gives a sample of one of the intermediate versions of the tongue tracking algorithm that we have been developing.  The greyscale video sequence is the raw ultrasound scan data of a child saying "k... aka .. iki... oko".  The bright moving edge corresponds to the tongue surface in the midsagittal plane (facing to the right). The overlaid magenta contour is the result of our fully automatic tongue tracking algorithm.   The magenta contour tracks the underside of the bright moving edge reasonably well.  It also approximates the shape of the tongue in places where the ultrasound data fades to practically nothing very well.  Compared with previous versions of our work (e.g. see below),  this version is a great step forward.  Still room for improvement though (compare this with our most recent version above!).

 

Preliminary tongue tracking (version 0.1)

Loading the player ...
 
This video is an example of (almost!) the very first version of our tongue tracking work.  The greyscale video sequence is the raw ultrasound scan data of an adult male saying "l... ala .. ili... olo".  The bright moving edge corresponds to the tongue surface in the midsagittal plane (with the person facing to the right). The overlaid red contour is the result of our first attempt at implementing an automatic tongue tracking algorithm.  The blue contour is an indication of the roof of the mouth for this person - this is estimated from the furthest extents of the tracked movements of the tongue.  The estimated tongue contour assumes roughly the correct shapes with well synchronised movements, but does not always correspond closely to the bright edge of the tongue surface. Though partially successful, we had to go back to the drawing board and start completely from scratch to improve on this approach.
Document Actions