In this article, we demonstrate how the Vitali and Bernstein constructions together with a simple theory on semigroups and ideals of sets can be used for producing different semigroups of sets without the Baire property and/or non-measurable in the Lebesgue sense.