According to Popular Mechanics (emphasis added):
More people have been to space than have flown in a B-2.
... A B-2 pilot at Whiteman [Air Force Base] told me that the number of astronauts who've been to space is larger than the number of people who have flown in a B-2. I look it up and find it's true: As of that moment, 552 people had traveled into space. Only 543 people have ever flown in the cockpit of a B-2. Upon landing I'll become number 544, with the new Air Force handle "Spirit 544."
Have more people "been to space than have flown in a B-2"? Verify this as of the time of the article's publishing. @DenisS correctly points out this is over 6 years ago (January 7, 2013).
Bonus (250 rep): How many people have flown in a B-2 as of January 1, 2019? If this is too recent, any supported value after the date of January 1, 2014 will also get awarded the bonus.
I am asking this question because I cannot find another source with the number of people who have ever flown in the cockpit of a B-2 at any time, so it would be interesting that this one source has such an exact number (544).
Note: I have tried asking a similar question on Aviation.SE.