This paper presents an overview of the project “Classification of multivariate medical datasets using deformable models” and the current work within the project. The project is a joint venture between the Department of Biomedical Engineering (Linköping University), the Center for Medical Image Science and Visualization (Linköping University) and Sectra Imtec AB (Linköping) and focuses on extending a deformable model approach, named the Morphon, to 3D and to utilize multi-variate data with multiple priors. Recent work in the project includes evaluating different methods for estimating the displacement field and automatic scale control.