Sorry about the delay on this one, I created a minimal example and could not reproduce the issue
But then I tried setting all the configs to be the same in the full pipeline and the problem manifested again.
After some digging it seems that using `stereo->setDepthAlign` is causing the issue, it seems to scale the resolution to the targeted socket (expected behavior) but ignores the reduction from the decimation filter