Cancer is a widespread type of diseases that each year affects millions of people. It is mainly treated by chemotherapy, surgery or radiation therapy, or a combination of them. One modality of radiation therapy is high dose-rate brachytherapy, used in treatment of for example prostate cancer and gynecologic cancer. Brachytherapy is an invasive treatment in which catheters (hollow needles) or applicators are used to place the highly active radiation source close to or within a tumour.

The treatment planning problem, which can be modelled as a mathematical optimization problem, is the topic of this thesis. The treatment planning includes decisions on how many catheters to use and where to place them as well as the dwell times for the radiation source. There are multiple aims with the treatment and these are primarily to give the tumour a radiation dose that is sufficiently high and to give the surrounding healthy tissue and organs (organs at risk) a dose that is sufficiently low. Because these aims are in conflict, modelling the treatment planning gives optimization problems which essentially are multiobjective.

To evaluate treatment plans, a concept called dosimetric indices is commonly used and they constitute an essential part of the clinical treatment guidelines. For the tumour, the portion of the volume that receives at least a specified dose is of interest while for an organ at risk it is rather the portion of the volume that receives at most a specified dose. The dosimetric indices are derived from the dose-volume histogram, which for each dose level shows the corresponding dosimetric index. Dose-volume histograms are commonly used to visualise the three-dimensional dose distribution.

The research focus of this thesis is mathematical modelling of the treatment planning and properties of optimization models explicitly including dosimetric indices, which the clinical treatment guidelines are based on. Modelling dosimetric indices explicitly yields mixedinteger programs which are computationally demanding to solve. The computing time of the treatment planning is of clinical relevance as the planning is typically conducted while the patient is under anaesthesia. Research topics in this thesis include both studying properties of models, extending and improving models, and developing new optimization models to be able to take more aspects into account in the treatment planning.

There are several advantages of using mathematical optimization for treatment planning in comparison to manual planning. First, the treatment planning phase can be shortened compared to the time consuming manual planning. Secondly, also the quality of treatment plans can be improved by using optimization models and algorithms, for example by considering more of the clinically relevant aspects. Finally, with the use of optimization algorithms the requirements of experience and skill level for the planners are lower.

This thesis summary contains a literature review over optimization models for treatment planning, including the catheter placement problem. How optimization models consider the multiobjective nature of the treatment planning problem is also discussed.