Is it legal to use "royalty free" samples in music I plan to distribute?

Many sample archives claim that all their samples are 100% royalty free, but how do I tell if I can legally use the samples in distributed work? Would it be wise to avoid using these samples altogether?