Why is it difficult to determine where cosmic rays come from?

Because cosmic rays are composed of charged particles their paths can be altered by any magnetic field that it comes into contact with. Naturally, objects like stars and planets have magnetic fields, but interstellar magnetic fields also exist ... Determining the source of cosmic rays proved difficult for many years.