At the end of the day, you always do what you want (because if you didn't want to do something you wouldn't)
This is sort of the next level of palisade that one can build. You can skirt the issue that you give certain animals certain rights by claiming that you only give humans rights. If you then want to avoid that level of special pleading, you can claim that you don't give anyone else rights except yourself and whatever you desire. In short, that might makes right.
The problem is that this is still special pleading, namely that you are attempting to give yourself rights that you don't give anyone else. So then that would mean that you alone are the object of moral value. So to avoid this fallacy, you would need to demonstrate that you have some property that is unique to you that showed that you alone have subjective experience or that your experience is qualitatively different from everyone else on the planet. For instance, if you were the only person on Earth that demonstrated activity in an fMRI machine, and everyone else had a completely blank scan. Barring any unusual properties that you alone have, you would not be logically justified in making such an assertion. Not even "But I am the only person that I can verify has subjective experience" because anyone can say that.
Barring any such demonstration, the argument falls apart.