In this report, the Direct Weight Optimization (DWO) approach to function estimation is studied for two special function classes: The classes of approximately constant and approximately linear functions. These classes consist of functions whose deviation from a constant/affine function is bounded by a known constant. Upper and lower bounds for the asymptotic maximum MSE are given, some of whic halso hold in the non-asymptotic case.