Since they get smaller with finer meshes it seems that the staircase approximation is the reason. You can set a function instead of a constant value at the bounderies depending on there exact position if you have an analytical solution. Then, the fluctuations should be gone.