Aren’t you neglecting changing the system as a whole?

No, not at all, actually. The principles of effective altruism don’t reject changing social systems for the better. Since we are concerned on anything that is effective in improving the welfare of sentient beings, any systematic approaches to achieving this ought to be taken seriously and many people are looking at exactly this.