There is a growing body of literature which suggests that decisions about healthcare priority setting should take into account the extent to which patients are worse off. However, such decisions are often based on how badly off patients are with respect to the condition targeted by the treatment whose priority is under consideration (condition-specific severity). In this paper I argue that giving priority to the worse off in terms of condition-specific severity does not reflect the morally relevant sense of being worse off. I conclude that an account of giving priority to the worse off relevant for healthcare priority setting should take into account how badly off patients are when all of their conditions are considered (holistic severity).