Using single quotes instead of double quotes should work. Or just put "set +o histexpand" in your .bashrc ...