Physics cannot justify why anything is morally right or wrong. No one says that is a defect of physics because that’s not what physics is about.
Like physics, atheism is also not about morality. So why should it be a defect of atheism that it cannot justify why anything is morally right or wrong?