Being one of the world's most lusted-after men has its downfalls, as Robert Pattinson has been discovering during his recent shoot in New York. The actor is reportedly totally "fed up" of being chased and manhandled by his army of female fans, and he can't wait to get back to London where – get this – the fans are a lot "cooler". An insider from the set of Remember Me in New York explained, "Robert is dying to get back home. He's overwhelmed by all the girls – they terrify him! He says girls grab his neck and clothing all of the time, and he’s not used to that. Fans don’t do that to him in London. Everyone there is a little cooler about the fame thing, which is what he’s used to." The stress is even causing poor Rob to drop weight, and his co-stars are said to be very worried about him. "Robert doesn’t understand why everyone is going so crazy over him," continues the insider. "He’s embarrassed by the way girls throw themselves at him. The girls here are stalking him. He's afraid that if he gives a hand, they’ll take the whole arm. He’s being advised by security not to encourage the crowd, so he doesn’t even look up anymore." Poor Rob... If you're reading this, feel free to come and hide out at heatworld's bedroom house for as long as you like...