Are Poppy seeds safe during pregnancy?

Last night, I went out to eat and ate two Chicago style hot dogs and the buns that they were in, were poppy seed buns. I ate the buns as well not really thinking about the fact that they were poppy seeds. When I got home, my mom told me that poppy seeds are unsafe to eat when you're pregnant. Does any one know if that's true or if she is just worrying too much? I am 38 weeks pregnant and I just don't want my baby to be like drugged up or anything. It's probably a stupid question, but I don't know if it's important enough to call my doctor or not. Any information helps. Thanks!