Some people recommend avoiding citrus and onions in compost and worm farms typically because worms don't like it in the early stages of decomposition.
I've never followed that rule personally and my compost system works really well. I get some black soldier fly larvae and other vermiculture in the early stages. In case you're wondering the black soldier flies aren't annoying like houseflies and typically steer clear of homes and humans. I usually only see a few BSFs around the compost and sometimes a lot of larvae, but it's seasonal.