Agree entirely. BGs hurts us the most on the defensive end, and Carr's a much higher IQ defender than Garrison. Carr's biggest issue defensively is his lack of speed which in theory should be negated by guarding 5s, though he will be forced to hedge and recover a lot more in PnR, something Garrison is currently terrible at.
Offensively it limits you more than with Carr at the 5, but Carr at the 5 and Almonor/Noah at the 4 is likely better than Garrison at the 5 and any of those guys at the 4. But even if its similar, the defensive improvement is by far where it will pay the most dividends. Duke game is a great example of this.