I never said they are the "most important", but simply they are "important". Your race or gender isn't the totality of who you are, but it is surely a part of you, your identity, and how people treat you. To ignore it also perpetuates racism, even among well-intentioned folks.
No, it's incredibly racist and sexist to think those things are the most important distinctions of who you are.