It shouldn't smell if you make it properly. If it smells bad, then it is bad. If it smells earthy-ish, then it is fine. The smell should not be repugnant or strong, it should smell like a fresh bag of soil.
My compost teas smell a little earthy, kelp tea smells like seaweed (go figure) ...other than that they don't smell bad.