Optical Conductivity and Pseudo-Momentum Conservation in Anisotropic Fermi Liquids