Everyone has different taste buds, they can be more and less sensitive to different things and stimuli... do you use a joint or bowl? Try a bubbler or bong, and try keeping hydrated.. there are a couple things that can reduce your sense of taste, dehydration is one of them. Even if it's a liquid you're consuming, if you are currently dehydrated at the time, it won't taste as strong or quite as it should. Do you use a lighter to smoke? Try a hemp wick, or you could combust or vape using a glass wand. Reducing it down to a vapor shouldn't effect your sense of taste much at all, but
well flushed and properly dried/cured buds should be fine for even smoking, without the exposure to anything extra to shock and dull your taste buds.
The more-acrid and bitter smoke produced by residual salt content and improperly broken down chlorophyll, even if it's faint, can desensitize your taste buds much more noticeably compared to the smoke from a batch of herb that was better cared for... when the smoke is a bit
bitter, subtle tastes like milk can be lost on your tastebuds, and sour flavors can be easily ignored.
You may also want to try enjoying the effects of your herb for a half hour, to an hour or so after smoking, instead of eating right away, giving the enzymes and bacteria in your mouth the opportunity to cleanse things up a bit. That aside, your mouth and taste buds could just need a bit more time to 'reset' between smoking and eating sessions than others.